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PREFACE 


THE present volume is based upon a course in Real Variables 
given for some years at the University of Illinois and is intended 
as a companion volume to the author’s book on Complex Variables. 
It presupposes such knowledge of mathematics as the student will 
have had who has completed the usual undergraduate course in math- 
ematics including a year’s course in calculus and perhaps an elemen- 
tary course in differential equations or a course in advanced calculus. 
The purpose of the course is to discuss those topics which will enable 
the student to have a better grasp and understanding of the funda- 
mental principles of the calculus of real variables and know some- 
thing of the more recent developments of this branch of analysis. 

As an essential tool in the development of the subject, there has 
been introduced some of the more elementary notions of point sets. 
For convenience in reference, or to the reader who wishes to become 
familiar with this subject only, the general discussion of point sets 
is presented in a single chapter. In using the book as the basis of a 
course in Real Variables, it may be found more convenient to post- 
pone certain portions of this chapter until they are actually needed in 
the discussions which follow. Thus, the articles on content and 
measure may well be postponed until the subject of integration is 
considered. . 

It has been the purpose to limit the amount of material to what 
can readily be covered in a year’s course of three or four hours per 
week, and to select those topics for discussion which the student 
might well know who expects to teach calculus or to continue his 
study of analysis. In accordance with this plan, there will be found 
from time to time a general statement of facts, made without formal 
proof, where these facts are not essential to the logical presentation 
of an introductory course in the subject. In such cases, reference 
is made to the original sources of information for the use of the 
reader who wishes to verify the conclusions stated. These refer- 
ences may well be made topics of special report in the class room by 
those students who desire to cover the subject more fully. The 
dates of some of the more important theorems, as well as other 
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historical data, are given in foot-notes for the convenience of those 
who wish to trace the historical development of the subject. 

The book was first used in mimeograph form as a text in the course 
given by the author. Many suggestions of those taking the course 
have been incorporated, which it is hoped have added to the value of 
the book as a class room text. The author wishes to acknowledge his 
obligations to Professor W. B. Ford of the University of Michigan and 
Dr. C. M. Huber of Rutgers University who have read the galley 
proof sheets. He wishes also to acknowledge his indebtedness to 
Professor T. H. Hildebandt of the University of Michigan who has 
offered many valuable suggestions for the improvement of the chapters 
on integration. While these friends are not in any way responsible 
for such defects as the book may possess, their encouragement and 
criticisms have been most helpful in its preparation. 
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ERRATA 


Line 1 below (2), readn = m forn >™m. 


Ex. 12, read {(1 = x)" for {(1 + =) 


Line 19, read ‘‘ within ”’ for “ with.” 

Line 2, Theorem IV, insert ‘‘everywhere dense, non-abutting and” 
after ‘‘set of.” 

Line 12 from bottom, read k S$ m+nfork=m+n. 

Line 4 below Theorem I, read “‘ finite’’ for “arbitrarily small.” 

Theorem V, line 1, read ‘‘a bounded sequence of discrete sets.” 

Line 4, read m[C(A)] +m(A2). 

Line 1 below Fig. 12, read Z for LZ . 


z—0 no 

Ex. 5, line 1, read y® for y? in denominator of the fraction. 
Lines 3, 4 should read: A —€: S$ f(z) $A +6, or—& Sf(x) —A S &. 
Line 5 of Ex. 3 read 0-y in numerator of fraction for 0-2. 
Line 7 from bottom, read | A —f(%) | for | A —f(z) |. 
Lines 16, 20, 23, read 2; for ne. 
Line 5 from bottom, read ‘‘small, positive number” for “selected.” 
Line 3, Theorem III, read “‘small, positive’”’ for ‘‘ chosen.”’ 
Line 8, read L f(x,y) =f(x0,yo). 

LZ 


y-Vo 

Line 22, read A = f,(x) = B. 

Line 3, omit “or less.” 

Line 6 from bottom, read “‘ the oscillation of F(a, Ax)’ for “‘ if f’(ao) 
exists, the saltus of f’(x) at 2’; in (2) read “‘w(F, 2)” for 
(a3 w(f’, Xo). ” 

Line 11, read R, for R. 

Inequality (1) should read S(c) < S(o) < S(o). 

Cor. line 8, read ‘‘ small, positive 2 number” for “chosen member.” 


Insert 4 before the integral ike ane dt. 
o vt 


Line 2 below Theorem V, read < for < between the integrals given; 
es) 


Ex. 5, read f for 
Line 4 from bottom, read XI for IX. 
Line 11, read A 2 m(Hx) for Am(E). 


k= 
Line 4 from poten read “for every value of € > 0 and’ for “we 
select an € such that.” 
Line 1 from bottom, omit “of.” 
Line 18, read “the function f’(x) ” for “the function f(z).” 
Line 2 from bottom, omit ‘‘be continuous ”; line 3 from bottom, in- 
sert ‘“may be” after ‘function.’ 


Line 2 below Theorem III, read J S’n(x)dz. 


a 
Line 4, read “ Theorem IX” for ‘‘ Theorem III.”’ 
Line 1 from bottom, insert = after u(z, y). 


Note: The omission of a limit of integration from integral signs has not been 
listed where it can be supplied without ambiguity. 
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FUNCTIONS OF REAL VARIABLES 


CHAPTER I 
REAL NUMBER SYSTEM 


1. Rational numbers. The process of counting involves a knowl- 
edge of the positive integers 1, 2, 3,. . . , often called the natural 
numbers. One also obtains this class of numbers by assuming the 
concept unity and the knowledge of a certain process called addition. 
When we admit the inverse operation of subtraction, we are led to in- 
troduce negative integers and zero in order always to interpret the 
results. 

Again, when we divide one integer by another, we find it necessary 
to introduce another class of numbers in order always to be able 
to interpret the results, namely fractions. 

The totality of numbers thus far considered, namely positive and 
negative integers, zero, and fractions constitute a class of numbers 
called the rational numbers. These numbers constitute a number- 
system having certain properties; for example, they constitute a 
closed set with respect to the processes of addition, subtraction, 
multiplication, and division. In other words, if these operations are 
performed upon rational numbers, the results are always rational 
numbers. Every rational number can be expressed as the quotient 
of one integer by another; that is, it can be expressed in the form 


3 where p and gq are integers prime to each other and gq is different 
from zero. 


Division by zero must be excluded from consideration, since it can 
not lead to a definite result; for, we should then have a rational num- 


ber & such that p 
eee 
0 
and, therefore, if we admit the fundamental laws of arithmetic, 
p =0-k. 


This relation allows k to be any rational number, which is contrary 


to the assumption that it was a particular number. 
1 
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By the process of addition and subtraction of unity, the integral 
numbers may be placed in a definite order of rank, so that we are able 
to say that one integer is less than or greater than another; that is, 
one has a higher or a lower rank than the other. Of two rational 
numbers, we say that the one is less than or greater than the other if, 
when reduced to a common denominator, the one numerator is less 
than or greater than the other. When arranged in order of rank, 
an aggregate of numbers is said to be ordered. If 21, x2 are the two 
numbers, we express symbolically the fact that 2; is less than or 
greater than x2 by writing respectively 


U1 < Xe, M1 > Xe. 
The number z is said to lie between x, and 22 if we have 
Te ae X2, 


where 2 is less than zz. Between any two rational numbers, there is 
always another rational number. To show this, all we need to do is 
to take one-half of the sum of the two given rational numbers. The 
resulting number is rational and lies between the two given numbers. 
This process of subdivision may be carried on indefinitely, and hence 
the foregoing statement is equivalent to saying that between any 
two rational numbers there exist an infinite number of other rational 
numbers. 

We shall denote the absolute value of a number 2 by writing 
| x1 |, read ‘“ the absolute value of x1’’, by which we mean its numerical 
value independently of whether it is positive or negative. Thus, 
we have | x2 | = | — 2 |. 

We shall speak of a number as being arbitrarily small if it may be 
chosen as small as we please but is different from zero. We shall 
commonly denote such a number by e. As applied to positive num- 
bers, the expression ‘‘as small as we please’”’ is understood to refer 
to the rank of the number in an ordered system. 

The elements of one aggregate are said to bein a one-to-one cor- 
respondence with those of another when to each element in the one 
there corresponds one and only one element of the other, and con- 
versely. Thus, there exists a one-to-one correspondence between the 
chairs and the persons in a room when to each person may be assigned 
one and only one chair, and conversely with every chair there may be 
associated one andonlyone person. Likewise, there is a one-to-one cor- 
respondence between the terms of an infinite series and the positive 
integers, since we can put the subscripts 1, 2, 3, . . . on the terms. 
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2. Sequences of rational numbers. An ordered, infinite aggregate 
of rational numbers 
Qi, Mz, °°: Cnya 


having a one-to-one correspondence with the positive integers in their 
natural order is called an infinite sequence, or more briefly a sequence 
of rational numbers. The individual numbers composing the se- 
quence are called the elements of the sequence. A sequence always 
has a first element, and to each element there is a definite one 
which follows. Moreover, each element, except the first, is pre- 
ceded by a finite number of other elements and every one is followed 
by an infinite number of elements. The sequence 


ai, Q2, rece » An, . 


will be denoted symbolically by {a,}. We shall now consider some of 
the special properties of sequences of rational numbers as a basis for 
a more precise consideration of certain fundamental definitions and 
operations. 

It is to be noted that a set of numbers may form a sequence if 
arranged in one way, but not if arranged in some other manner. 
Thus, the set of natural numbers form a sequence if arranged in the 
order of rank. However, if we take first the succession of even 
integers followed by the succession of odd integers, we should not 
have a sequence; for, such an arrangement does not have a one-to- 
one correspondence with the positive integers which preserves the 
order of arrangement of the numbers. 

If the absolute values of the elements of a sequence do not exceed a 
definite value, then the sequence is called a bounded sequence. 

A sequence of rational numbers {a,} is said to converge if, for each 
arbitrarily small positive rational value assigned to e, there exists a 
definite integer m, such that for every integer n > m, we have 


(ay Sh, Bip Se pel yg 28h ote: 
Thus, if there exists a rational number A such that for all the values 
of n greater than a certain integer m, we have 
|A—a,|<€, 
where € is an arbitrarily small positive rational number, the sequence 
{a,}is said to have the rational limit A, and we write 
L {an} = A. 


n>, 


If A is not rational, the limiting process has no meaning in a number 
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system composed only of rational numbers. A convergent sequence 
is also called a regular sequence. 
We have the following theorems concerning regular sequences. 


TuroreM I. Bvery regular sequence of rational numbers is bounded. 


Let the given sequence of rational numbers be 
{an} = a, Qe, = ore pins ee a 
We must show that there exists a finite positive integer M such that 
| dn | <M,n= 1; 2, 3, i ite 
Since the sequence is convergent, it follows from the foregoing 
definition that there exists an integer m such that for every n > m we 
have 
| Ghbs Han |< 6) te 2 pee (1) 
Let M be equal to or greater than the numerical value of each of the 
numbers 
Qi, Az, * * *, Amy Am — €, Om + €. (2) 
From (1) it follows that for n > m, we have 
Om —\€ < Gn. Gn EG 


that is, from a, on, all subsequent elements must differ from a» by 
less than ¢. Since M is equal to or greater than the absolute value 
of every number given in (2), it follows that 


[an] <M, 


whatever value is assigned to n. 
It must not be inferred from this theorem that a convergent se- 
quence is always increasing or always decreasing. It may change 
from an increasing to a decreasing sequence, or vice versa, but in no 
case can an element exceed in absolute value a certain number. 
There are sequences which never decrease and others which never 
increase. Such sequences are said to be monotone. A sequence 
which never decreases is called a monotone increasing sequence, 
and one which never increases is called a monotone decreasing se- 

quence. Thus 
1 1 =o 1 


‘oa 
ie eee als epee le 
ptt Tg? Pe oS ee eee 


is a monotone increasing sequence; 


1 
1, l= 1=4=h1-F59-4 <=. 
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is a monotone decreasing sequence. The sequence, 


1 1 1 | ae 1 
~ 37’ 1-3 te fein a. ee 


on the other hand, is not monotone. 


1 


THeoreEM II. Jf a regular sequence of rational numbers does not 
converge to the limit zero, its elements must be from some point on 
either all positive or all negative. 


Let us suppose the contrary to be true; namely, let us assume that 
there is no point beyond which the elements are either all positive or 
all negative. Then, however large we select n, there exists a value 
of p such that a,+, and a, have opposite signs. Since the given 
sequence {a,} is regular, we have 

| Qutp —a. |< €,p =1,2,3,---,n>m. (3) 
For those values of p for which a,., and a, have opposite signs, the 
absolute value of the difference between them must be greater than 


either number. Consequently, the only way that the relation (3) 
can exist is that we have 


pases esp ay) <e 


However small we select the number e, it follows that there exists 
some element of the sequence such that it and all following elements 
are numerically less than €. Consequently, the sequence must con- 
verge to the limiting value zero, but this conclusion is contrary to 
the assumed hypothesis. Hence, the theorem follows as stated. 


TueoreM III. A bounded monotone sequence of rational numbers 
is convergent. 


We shall assume that the given sequence does not converge to 
zero; for, in that case the theorem is established. As the sequence is 
monotone, it follows that the elements are ultimately all positive or 
all negative. We shall prove the theorem for monotone increasing 
sequences whose terms are ultimately all positive. The proofs for 
decreasing sequences and for sequences whose terms are ultimately 
all negative are similar and are left to the reader to supply. 

Let {a,} be the given sequence; then by hypothesis we have for n 
greater than a definite m 

|an| < M, 


where M is some finite positive integer. 
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We shall prove the theorem by assuming that the given sequence 
is not convergent and showing that this assumption leads to a con- 
tradiction of the given hypothesis. We assume then that a positive 
integer m does not exist such that for n > m we have 


[ Cnty — Gn | <p 2, oy ee (4) 


that is, however large we select m there exists an n>m such that for 
some positive integer p we have 
{On — alee 

Denote by n, and p; the corresponding values of n and p for which 
this condition is true; that is, the relation (4) is false. Since the 
given sequence is monotone increasing and its elements ultimately all 
positive, we have 

& 


An,+p, — In, , 
€, where nz = m1 + Pr, 


Zz 
Onot+D. care Ang = 


On,tp, — On, = €, Where nz, = Nea + Pe, 


Making use of the relations between n; and nx-1 + Pra, we have 


Any = An,+n, = Qn, 2 €, 
On, = Ontp, = An, + 2€, 


Any ty = Ant py, 2 An, aR ke, 


For a given €, k may be taken sufficiently large so that the prod- 
uct k-€ may be made as large as we please; for, it will be seen that e€ 
is first chosen and that / may be taken as large as we please. Hence, 
k-e may be made larger than M. The rational numbers a», are ele- 
ments of the given sequence. The conclusion that k-« may be made 
to exceed M, and hence -k may be so chosen that 


Ani, 2 Om tke > M, 


contradicts the hypothesis that the given sequence is bounded. From 
this contradiction the theorem follows for the case considered; 
namely, where the elements of the sequence are all positive and the 
sequence is monotone increasing. 

We assume with Cantor that corresponding to every regular 
sequence of rational numbers there exists a uniquely determined 
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object called a realnumber. We express this fact by saying that every 
regular sequence of rational numbers defines a real number, which is 
represented by the sequence. Every rational number itself can be 
represented by such a regular sequence. Thus, the rational number 
a is represented by the sequence 


Capt. 


and since the real number uniquely defined by this sequence corre- 
sponds to the rational number a, it serves the purpose of analysis to 
say that it is a. 

While every regular sequence of rational numbers defines one and 
only one real number, it does not follow that a given real number 
may not be represented by more than one such sequence. 

Thus, the sequence 


Sepd eS ed NTE te 
i 2? 3? 4? 5? 6? 7 


is regular since the difference between the n element and any 
succeeding one may be made smaller than any arbitrarily small 
positive number ¢ by taking n sufficiently large. This sequence de- 
fines the number 1, as we may see by inspection. In the same way 
it may be shown that the number 1 is also defined by either of the 
following regular sequences 


jel oe ey Tee 


B) 3) ty BB ° Then 

3. Irrational numbers. While the class of real numbers includes 
all rational numbers, we shall now see that it also includes some that 
are not rational. Indeed, the system of rational numbers is not ade- 
quate for the purposes of analysis. For, when the operation of root 
extraction is included in the processes of arithmetic, we can not 
always interpret our results in terms of rational numbers. For ex- 
ample, +/2 can not be so interpreted; that is, it can not be expressed 


in the form 2 where p and q are integers prime to each other. To 


show that this is the case, let us put 
V2 =&, 
q 


and examine the consequences of such an assumption. Squaring 


both sides, we have p 
2 = + or p* = 24". 


? 
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The number 2 must then be a factor of p?, and since p? is a square, 
each of its factors must appear an even number of times. Hence, 2 
must appear an even number of times on the one side of this equation 
and consequently the same number of times on the other; that is, it 
must appear an even number of times as a factor in 29’. Conse- 
quently, 2 is a factor of g, and again as this is a square it must appear 
an even number of times ing”. It follows then from the given assump- 
tion that 2 appears as an even number of times as a factor of one 
member of this equation and as an odd number of times of the other 
member. This is impossible and hence our assumption that V2 isa 
rational number is false. 

However, the process of extracting the square root of 2 gives as the 
successive approximations the sequence 


1, 1.4, 1.41, 1.414, 1.4142, 


The difference between the n” element and any succeeding one 


can not exceed By taking n sufficiently large, we can take 


1 
this difference as small as we please, and consequently the definition 
of a convergent sequence of rational numbers is satisfied and, in 
accordance with the assumption that every such sequence defines a 
real number, we may conclude that this sequence defines in the limit 
the number V2. 

It is evident from the foregoing discussion that the class of real 
numbers includes some numbers like V2 which are not rational. 
We shall call those real numbers which are not rational irrational 
numbers.! The ratio of the diameter of a circle to its circumference, 
the base of the system of natural logarithms, etc., furnish other illus- 
trations of irrational numbers already familiar to the reader. 

Whenever we extend our number system by the addition of a new 
class of numbers, it becomes necessary to define for the extended class 
of numbers the fundamental operations of arithmetic, and this must 
be done in a manner consistent with the definitions of these opera- 
tions for the more restricted class. Thus we shall have to make clear 


1 The existence of irrational numbers was known to the ancient Greeks and 
Hindoos. Their discovery was attributed by the Greeks to Pythagorus (about 
582-500 B.c.). The complete theory of such numbers was not, however, de- 
veloped in a satisfactory manner until the last century, when they were con- 
sidered by Geo. Cantor, Dedekind, and Weierstrass. The first of Cantor’s papers 
on the subject was published in 1871. In 1872 Dedekind published his theory 
of irrational numbers in his Stetigkeit und Irrationale Zahlen. 
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what is meant by the addition, multiplication, etc., of real numbers. 
The definition of these fundamental operations must be such as to be 
consistent with the definitions of the same processes for rational 
numbers. We shall need also to see whether the formal laws of 
arithmetic, such as the commutative and associative laws of addition 
and the commutative, associative, and distributive laws of multipli- 
cation hold equally well for the system of real numbers as for rational 
numbers. We shall consider these questions in the following articles. 

4. Cantor’s theory of irrational numbers. Cantor developed 
the theory of irrational numbers from the properties of regular 
sequences of rational numbers. Some of the essential features of this 
theory have already been considered. To complete his theory, it 
remains to formulate the definitions of such terms as equal, greater 
than, less than, and of the fundamental processes of arithmetic, based 
upon regular sequences of rational numbers. As already mentioned, 
all such definitions and processes must be so formulated as to be 
consistent with the corresponding definitions already set up for 
rational numbers. 

Given two real numbers A and B defined respectively by the 
regular sequences {a,} and {b,} of rational numbers. We say that 
A is equal to B and write Piers 

? 


if there exists some integer m such that we have for all values of n > m 
| Gntn — Dnt | 6 pee 8, 


where € is positive and arbitrarily small. The two sequences {an} 
and {b,} then define the same number. In order that A and B shall 
be equal, it is not necessary that a, and 6, be equal for all values of 
n; for, as we have seen, the same number can be represented by a 


regular sequence in a great variety of ways. | 
.Of the two numbers A and B, A is greater than B, written A > B, 


if we have for all values of n > m 

itp — Uap Up = 1, 2, 3, eae 8 
where M is a real number independent of n. Similarly, A is said to 
be less than B, written A < B, if we have for n > m 

One = Varna 0) Pomel 02,3, ,* na 

If A < Band B < C, then it follows that A < C. As this is true 

for any three real numbers, the class of real numbers is said to form 
an ordered system. 
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The sum of the two numbers A and B is defined by the relation 


A +B =F {an} aR {bn} 
ai + b1, dz + be, a3 + b3,° + *, Anton °° 
{an + bn}. 

By use of this definition the laws governing the addition of rational 
numbers may be extended to the class of real numbers, including 
irrational numbers. Thus, the associative law holds, as may be shown 
as follows: Given the three real numbers A, B, C, defined by the regu- 
lar sequences rational numbers {an}, {b,}, {cn}, respectively. We 
have then 


(A +B) +C = {an + bn} + {en} 
(a1 + b1) + C1, (G2 + be) + 02,°° * 
= +bi+ 1, d2+b2+02,,+°- 
=a + (61 + 1), d2 + (b2 + €2),° °° 
{an} + {On + Cn} 
=A+(B+C). 

In a similar manner the commutative law of addition may be 
shown to hold. 

We may define the product of two numbers A and B represented 
by regular sequences of rational numbers by the following relation 


A-B= {dn} {bn} - {Gnbn} = d1b1, Gobo, asbs, - - - 


From this definition the laws of multiplication follow as for rational 
numbers. We shall show that the distributive law holds and leave 
the proof for the remaining laws as an exercise for the reader. 

Given the three real numbers A, B, C, defined respectively by the 
regular sequences of rational numbers {dn}, {bn}, {cn}, we then have 


(A + B)C =[f{an} + {bn} ]fen} 
(a ae bi)c1, (a2 ae bz) C2, (as ae bs) ¢3, OmeGs 


Il 


ll 


ll 


= A1C1 + bic1, AeC2 + beee2, asc3 + b3¢3, + + ° 
= (arc, Q2C2, A303, ° ° -) ie (b1c1, bee, bsC3 + * -) 
= AC + BC, 


as was to be shown. 

From the definitions of addition and multiplication follow at once 
those of the inverse operations of subtraction and division. By the 
multiplication of a number by itself we are led to the integral powers 
of a number, and the inverse operation gives the extraction of roots, 
These definitions of subtraction and division hold for any real num- 


Art. 5] DEDEKIND’S THEORY OF IRRATIONAL NUMBERS in 


bers, rational or irrational. The definition of a power may be gener- 
alized so that it also holds for any rational or irrational exponent. 
For this purpose consider the numbers A and a defined respectively 
as the limits of the regular sequences of rational numbers {an} and 
{an}. Then by A* we understand the limit of the sequence 


Qa a fed (e4 
{dn a = 1, Ae 2 As eae sion 


which is seen to be regular. The inverse operation of root extrac- 
tion may be similarly generalized. It is to be observed, however, 
that the even roots of negative numbers can not be represented by a 
regular sequence of rational numbers. These numbers are not real 
and their consideration involves the introduction of a fundamental 
unit, 2 = V — 1, different from unity. Thus, we see that all of the 
fundamental operations of arithmetic may be defined for the system 
of numbers determined by regular sequences of rational numbers; 
that is, for both rational and irrational numbers, in such a manner 
that these generalized definitions are consistent with those already 
employed for rational numbers. 

5. Dedekind’s theory of irrational numbers. In defining real 
numbers, Dedekind made use of what he called a partition of the 
rational numbers. For example, let a be any rational number. Let 
the aggregate of all rational numbers be divided into two sets as 
follows. In the one set A put all those rational numbers which are 
equal to or less than a, and in the other set B all those rational num- 
bers which are greater than a. "The number a is then said to form a 
partition of the rational numbers. It serves the purpose equally well 
if the division is made by putting into the set A the rational numbers 
less than a and into the set B those equal to or greater than a. If 
the number a is assigned to A then it is the largest number in A, 
and there is no smallest one in B; if a is assigned to B then it is the 
smallest number in B and there is no largest one in A. In either case, 
the partition (A, B) is formed by the rational number a, and corre- 
sponding to every rational number there is such a partition. 

We may form a partition (A, B) of the rational numbers such that 
there is no smallest number in set B and likewise no largest one in 
set A. For example, suppose we put into A the number zero, all 
negative rational numbers, and all those positive rational numbers 
whose square is less than 2, and into B those rational numbers whose 
square is greater than 2. All rational numbers fall into the one set 
or the other. In this case, there is no largest number in A and like- 
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wise no smallest one in B. The partition (A, B) may then be said to 
define the irrational number V2. 

According to Dedekind the real number system consists of that 
aggregate of objects corresponding to the totality of partitions which 
may be formed from the system of rational numbers. As any rational 
number can be so represented, the system of real numbers then in- 
cludes all rational numbers. Those numbers thus defined that are 
not rational are called irrational numbers. This definition of irra- 
tional numbers may be formulated more precisely as follows: 

Divide the class of all rational numbers into two sets A and B 
having the following properties: 

1. Every number in A shall be less than any number in B, and 
hence every number in B will be greater than any number in A. 

2. There shall be no largest number in A and no smallest in B. 

This partition defines a real number, but it can not define a rational 
number, since all such numbers are included either in A or in B and 
none is the last of A or the first of B. It must then define an irra- 
tional number. 

This definition of an irrational number is equivalent to Cantor’s 
definition. To show this, it is necessary to show that every regular 
sequence of rational numbers may be made to correspond to one and 
only one partition of the rational numbers, and moreover, that all 
regular sequences representing the same real number by the Cantor 
definition correspond to the same partition. Conversely, it is neces- 
sary to show that to every partition of the rational numbers there 
corresponds one and only one regular sequence of rational numbers. 

Let {a,} be a regular sequence of rational numbers, thus defining 
a real number a by the Cantor theory. Let x be a rational number. 
Consider the regular sequence of rational numbers {a, — x}. By 
Theorem II, Art. 2, the elements of this sequence are ultimately all 
positive or all negative, provided it does not represent the number 
zero. Corresponding to the sequence {a,}, we form a partition of 
the rational numbers, if we put into set A all the rational numbers 
x for which (a, — 2) is ultimately positive, and into set B all those 
rational numbers x for which (a, — x) is ultimately negative. If 
there is a value x for which (a, — 2) is ultimately neither positive nor 
negative, then assign x to either A or B. 

Any other regular sequence of rational numbers {a,’} representing 
the number a must correspond to the same partition as {an}. For, 
the sequences {an’ — x} and {a, — x} are both convergent and the 
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elements of each must be ultimately either all positive or all negative 
unless the sequences represent the number zero. Hence, (a, — 2) 
and (a,’ — x) must have the same sign for all values of n greater 
than some integer m. It follows that if any given rational number z 
is assigned to the set A in the one case, it will be assigned to the set 
A in the other. Consequently, we have the same partition of the 
rational numbers in the two cases. 

We shall now consider the converse; namely, we shall show that 
corresponding to every partition of the rational numbers there exists 
a regular sequence of rational numbers. Suppose we have given a 
partition of the rational numbers. Let A and B be the two sets into 
which the rational numbers are divided. Let a and b; be any two 
rational numbers in A and B, respectively. Then the rational 


b 
number vee 


2 


lies between a; and b;. If it is a number of set A, then call it a, and 


put b. = bi. If $(a1 + bi) is a number of B, then call it b2 and put 
ad, = a. In either case 


dz + be 
2 


is again a rational number and lies between az and bs. Tf it is a 
number in A, call it a3 and put 63 = be; if it is a number in B, call it 
bs and put a3 = d. Take the arithmetical mean of a3; and 6; and pro- 
ceed as before. Continuing this process indefinitely, we obtain the 
two sequences of rational numbers 


{Gn} = ORI UDR NUE O° DP alin 22 Sve 
{bn} SOY, Was Ugaue hy Ons ans 


The first of these sequences is monotone increasing and the second 
is monotone decreasing. Both sequences are bounded, and hence 
by Theorem III, Art. 2 are convergent. Moreover, they represent 
the same real numbers; for, we have 


which is arbitrarily small for sufficiently large values of n. 

It follows then that corresponding to every regular sequence of 
rational numbers there exists a partition of the system of rational 
numbers and conversely. Moreover, the two methods of defining 
real numbers are equivalent in the sense that they lead to the same 
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system of numbers and any number which is irrational by the one 
definition is also irrational by the other. It follows that any property 
or any process which is developed on the basis of the one definition 
may also be developed on the basis of the other. 

6. The real number system. The class of real numbers is fully 
defined by regular sequences of rational numbers or by the partitions 
of such numbers. The definition of real numbers by either of these 
methods constitutes an enlargement of the notion of number itself. 
The introduction of irrational numbers makes possible the use, with- 
out restriction, of limits of sequences of rational numbers; for, in 
the domain of real numbers every regular sequence of rational num- 
bers has a uniquely determined limit which is the real number, 
rational or irrational, defined by that sequence, a conclusion which is 
not valid in the domain of rational numbers. 

We may speak of sequences of real numbers instead of rational 
numbers. Moreover, the definition of a convergent sequence can 
be extended to a sequence of such numbers. Thus, we say that a 
sequence of real numbers {a,} is convergent, if for an arbitrarily 
small positive real number ¢€ there exists an integer m such that for 
all values of n > m, we have 


[dn — Grip | < €, p = 1, 2, 3, - ars 


If there exists a real number A such that for all values of n > m 


we have 
| A — aa | < €, 


then A is said to be the limit of the sequence {a,} as n becomes in- 


finite, and we write 
L An = A. 
no 

Likewise, the arithmetical notions of equal, greater than, less than, 
as well as the definitions of the fundamental operations of arithmetic 
may be extended and defined by means of sequences of real numbers 
instead of rational numbers. All the theorems thus far demonstrated 
concerning regular sequences of rational numbers can be demon- 
strated for sequences of real numbers. 

Between any two real numbers a and b, there exists an irrational 


5 AEE Qa. ah 
number. For, let a@ be any irrational number, then 7 8 also irrational. 


The real number a is either rational or irrational. Suppose we assume 
it to be rational. We can so select n that 
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and hence we have wa + = << li 
nr 


OL : : Raf: ; ; 
Buta : is Irrational, since it is the sum of a rational and an irra- 


tional number. If we assume a to be irrational, we can find a rational 
number £ such that 

Bb <b-—a, 
whence a<a+68 <b, 


where a + @ is an irrational number. As we now see, there always 
exists between the real numbers a, b at least one irrational number. 

Likewise, we may show that between any two real numbers a, b, 
there exists a rational number. Consider any two rational numbers 
a, 8, wherea <a, 8>b. Then 


ySR a 


n 
are both rational. By the proper selection of x and n, we have 


a<a+*<b, 


but a + “ is a rational number. 


When we considered the totality of sequences of rational numbers, 
we were led to a new class of numbers, namely irrational numbers. 
If now we consider all of the regular sequences which may be formed 
from real numbers, would we not in the same way be compelled to 
make another extension to our number system? In other words, does 
every regular sequence of real numbers converge to a real number? 
To answer this question, we shall make use of the following theorem. 


TueoreM. Let {a,}, {b,}, and {cn} be three regular sequences of 
real numbers such that for all values of n 


Og Sg at. Ca, 
and if there exists a real number A, such that 


Dede: Mi y= 0AS 


no nro 


then we have | A eee. be 


no 


From the given relation 
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we have by subtracting a, from each member 
0 S bn — Gn S Cn — Gn. (1) 


From the condition that 
L a= L «=A, (2) 


we are able to determine an integer m such that for all values of 
n >m we have 5 eee (3) 
where € is arbitrarily small. It then follows from (1) that 

by — On < 6 > ™M. (4) 


It follows from the definition of equality that {b,} must then define 
the same number as {a,}, namely A, as the theorem states. 

In the foregoing theorem the elements an, bn, Cn of the given se- 
quences were all real numbers. The theorem must then hold for the 
special cases when the elements of one or all of the given sequences 
are either rational or irrational numbers. Suppose for example, a, 
and c, are rational numbers, it follows from the definition of real 
numbers that A is a real number. We may so select a, and c, as to 
define any real number A at pleasure. Since {b,} converges to the same 
number A, it follows that every real number may be represented by 
means of a regular sequence of real numbers. However, the theorem 
also holds when 6, is irrational, and hence any real number can also 
be represented by a regular sequence of irrational numbers. As we 
have seen, every real number forms a partition of the totality of 
rational numbers. Let {b,} be any regular sequence of real numbers. 
If we now take {a,}, {c,} to be sequences of rational numbers satis- 
fying the conditions of the foregoing theorem, then the sequence {b,} 
defines a real number A. As {b,,} is any regular sequence of real num- 
bers, it follows that every regular sequence of real numbers defines a 
real number. 

The system of real numbers forms a closed system with respect to 
the fundamental processes of arithmetic, including the extraction 
of roots of positive numbers and odd roots of negative numbers, and 
the limiting process; that is, when we operate upon a real number by 
any one of these processes, we always obtain a real number as a result. 
Consequently, the system of real numbers thus developed is sufficient 
for the purposes of a theory of functions of real variables. 

Aside from the division of real numbers into rational and irrational, 
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we may make other classifications. For example, if a real number 
is the root of an algebraic equation 


ApoE” + ya" * + + + ++ Anit + An = 0 


whose coefficients are rational numbers, then the number is called an 
algebraic number. The class of algebraic numbers includes all of 
the rational numbers and many irrational numbers. For example, the 
irrational number V/2 is a root of the quadratic equation 


oe — 2.— 0: 


The real numbers which are not algebraic are called transcendental 
numbers.' The numbers z and e, the base of the natural logarithmic 
system, are illustrations of such numbers. Since every rational 
number can be made the root of an algebraic equation with rational 
coefficients, it follows that all transcendental numbers are at the 
same time irrational, although the converse is not true. 

To know whether a given number is algebraic or transcendental 
is often of importance. For example, when it was shown that z is a 
transcendental number, that fact settled a problem which had at- 
tracted the attention of mathematicians for centuries; namely, 
whether it is possible by means of a straight edge and a pair of com- 
passes to construct a square whose area is equal to that of a given 
circle. For, as may be seen at once, only those numerical values are 
involved in the constructions made by these instruments which are 
the roots of an equation either of the first or second degree. Other 
problems in geometry, such as the trisection of an angle, the con- 
struction of a regular polygon of a given number of sides by means of 
ruler and compasses depend for their solution upon the numerical 
magnitudes satisfying the foregoing conditions. 

7. Geometric representation of real numbers. As in analytic 
geometry suppose we have given a straight line ZL and on this line a 
fixed point O called the origin. We shall speak of that portion of the 
line between any two points P; and Q; as the segment P:Q;. In 
order to have a basis for geometric interpretation of problems in 
analysis it is essential that we should have a one-to-one correspond- 


1 The existence of transcendental numbers was proved by Liouville in a paper 
published in Comptes Rendus in 1844. The number e was shown to be trans- 
cendental by Hermite in 1873, see Crelle, Vol. 76, p. 303. Lindemann in 1882 
showed that 7 also is transcendental in an article published in the Mathematische 
Annalen, Vol. 20, p. 213. See also article by D. E. Smith in Monographs on 
Modern Mathematics p. 402. 
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ence between the totality of points of a straight line and the totality 
of real numbers. This relation involves certain assumptions as to the 
continuity of the points on a straight line and the relation of these 
points to the system of real numbers.’ We shall point out what 
assumptions must be made. The first of these assumptions, known 
as the axiom of Archimedes, may be stated in geometric terms as 
follows. 

Axiom I. Given any two segments AB and CD of a straight line 
and suppose AB be the shorter; then there always exists an integer n 
such that n. AB > CD. 

No matter how short a segment AB may be chosen, the axiom 
asserts that it is always possible to choose n sufficiently large so that 
by laying off this segment n times from the point C the final point will 
be as remote from C as we may care to have it. We make the further 
assumption that any given segment may be divided into nm equal 
parts, and hence we have upon dividing by n also the relation 


Las 
n 


Let the length of the segment Oz, be taken as the unit of measure- 
ment. Then the point x; can be taken as representing the number 1. 


rGee te 


By laying this segment off a suitable number of times to the right and 
to the left of the origin of O, we get the points representing the natural 
numbers. As we have seen, every rational number can be written in 
P 
q 
of the foregoing assumption we can subdivide the segment Oz into q 
equal parts. By taking one of these parts as a unit of measure and 
laying it off p times, beginning at O, we obtain the point which repre- 


the form — where p and q are integers prime to each other. By virtue 


sents the rational number r. The system of rational numbers may 


therefore be represented uniquely by a set of points on a straight line. 
We shall speak of these points as the rational points of the line. Con- 
versely, to each of these points there corresponds one and only one 
rational number. There is then a one-to-one correspondence between 
the rational points of a line and the system of rational numbers. 


' See article by G. Cantor, Math. Ann. (1878) Vol. V, p. 28. 
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When we consider the correspondence between the irrational 
numbers and the remaining points of the straight line, we need to 
make a further assumption. The need and the nature of this assump- 
tion may be shown as follows. Let Ai and B, be any two rational 
points on L. Divide the segment AB; into n equal parts. Let 
A:Bz be one of these smaller segments. The points Az and Bz are 
also rational points, and as before the segment A.B, can be divided 
into n equal parts. Continue this process of division indefinitely and 
we obtain two sequences of rational points 


Aig Met oe Anas, 
Bi Bs, Bs,< 25. Bat 


Corresponding to these sequences of rational points, we have two 
regular sequences of rational numbers which we may denote respec- 
tively by {a,} and {b,}. As n increases indefinitely, the length of the 
segment A,B, becomes less than an arbitrarily chosen value e. We 
say that the length of the segment approaches zero as n becomes 
infinite. However, as n becomes infinite the two regular sequences 
{an}, {b,} define one and the same real number a. With Cantor we 
assume the following axiom. 


Axiom II. On the line L let there be given a sequence of segments 
{A,B,}, corresponding to the sequences {a,}, {bn} of rational numbers, 
satisfying the condition that each segment les within the preceding one 
and that the limit of the length of the segments A,Bn ts zero as n becomes 
infinite. Then there exists on L one and only one point A which divides 
all of the rational points {A,} from the rational points {B,}. 

This axiom is the geometric analog of the definition of real numbers 
by means of a partition of the rational numbers or its equivalent, a 
sequence of rational numbers. It is often referred to as the Cantor- 
Dedekind axiom or the axiom of continuity. 

As we have seen, every real number a forms a partition of the ag- 
gregate of rational numbers. Corresponding to such a partition of 
the rational numbers, there exists a sequence of segments {A,B,} 
satisfying the conditions of the axiom of continuity. The point A 
which is the limit of this sequence of intervals may be said to repre- 

sent the real number a. The foregoing axiom being assumed, we may 
conclude that to every real number there corresponds one and only 
one point on a straight line. 

Conversely, by aid of Axioms I and II it follows that if we have 
given any point P of a straight line, there corresponds one and only 
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one real number. For, lay off from the origin O the unit segment a 
sufficient number of times, say a1 times, so that by laying it off once 
more the terminal point will lie on the opposite side of P from O. 
Let Pi be the point corresponding to a; and Q; to a1 +1. Divide 
the segment P,Q; into n equal parts, which is equivalent to dividing 
the number one into n equal parts. Taking one of these segments 
as a measure, lay it off from P; a sufficient number of times, say a2 
times, so that we reach a terminal point P: on the same side of P 
as O, and laying it off az + 1 times we have a terminal point Q2 on 
the opposite side of P from O. The points P2, Q: then correspond 


é : 1 ; 
respectively to the rational numbers a; + = a+ a Continu- 
ing this process indefinitely, we have the two sequences of rational 
points Pi Py Pie eae 

Q,, Qs, Qs, - 5 =, Qn, ey 
and the corresponding sequences of rational numbers; namely, 
Ce ee ee ) 
een ie 


a4 ch ee eee 

no on i a eh 
It follows from the axiom of continuity that either of these se- 
quences of rational points approaches P as.a limit, while the corre- 
sponding sequences of rational numbers converge and define a definite 
number a. 

By aid of the foregoing axioms we have thus set up a one-to-one 
correspondence between the points of a straight line and the totality 
of real numbers. Because of this correspondence, all of the prop- 
erties and definitions stated for the real number system may be re- 
stated in geometric terms, and we thus have the possibility of a 
geometric interpretation of the problems of analysis. In what follows 
we shall often speak of the points a, 6, etc., meaning those points 
corresponding to the real numbers a, b, etc. 

The points of the straight line that are not rational are called the 
irrational points, and these points stand in a one-to-one correspond- 
ence with the irrational numbers. Whether any particular point is 
rational or irrational is not an inherent property of the point but 
rather depends upon the choice of a unit and of the origin. By 
changing the unit or the origin it may be made a rational or an 
irrational point at pleasure. The points on the line stand in the same 
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relative order as the corresponding numbers. Thus if the numbers 
a, b correspond respectively to the points A, B, then A is to the left 
of B if a < 6 and to the right in case a > b. 

It is possible to show the existence of a one-to-one correspondence 
between the elements of any finite segment of a straight line and 
those of a given segment, say (0,1). To do this draw straight lines 
through the extremities of the given segment (0, 1) and those of the 
other segment, which is assumed not to lie on the same straight line. 
The lines through the extremities meet in some point O. With this 
point as a center all of the points of the one segment may be pro- 
jected uniquely upon the other, thus establishing the desired one-to- 
one correspondence. 

By the properties of harmonic points, we may illustrate how 
a one-to-one correspondence may be established between the points 
of a straight line of indefinite length and those of an arbitrarily short 
segment AB. A corresponding ye 
analytic proof may be readily 
supplied by the reader. Upon 
AB construct a complete quad- G 
rilateral as shown in Fig. 2. From = 
the properties of a complete quad- 
rilateral it follows that the points , A 
C and D divide the segment AB - 
harmonically. To each position 
of C there corresponds one and only one point D, and conversely to 
each point D there is one and only one point C. As C varies from 
A to B the point D traverses the entire indefinite line exterior to 
AB, including the point at infinity in a projective sense, and thus 
the one-to-one correspondence is seen to exist. We may take the 
segment (0, 1) as the segment AB and hence there exists a one-to- 
one correspondence between the points of the indefinite line exterior 
to (0, 1) and those of the segment (0, 1). 

We shall speak of the segment of a straight line lying between 
the points A and B as the interval (A, B). Because of the one-to- 
one correspondence with real numbers, we shall also speak of the 
interval (a, 6) meaning the real numbers between a and b. If the end- 
points of the interval are included, we call it a closed interval, other- 
wise it is called an open interval. By a neighborhood of a point we 
shall mean an arbitrarily small interval inclosing the point. If the 
point is not included, we shall speak of it as a deleted neighborhood. 


Cas. D 
re. 2: 
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Just as we have a sequence of points, so we can have a sequence 
of intervals. The end-points determine the interval. If we denote 
by I, the interval whose end-points are dn, Cn, we may state the 
theorem of Art. 6 in geometric terms as follows. 


THEOREM. Given a sequence {I,} of closed intervals such that each 
lies within the preceding one and suppose 
L {Length of I,} = 90. 
no 
If P, is any point in the interval In, then every sequence {P,,} deter- 
mines one and the same limiting point P. 


The proof of this theorem is the precise geometric analogy of that 
of the theorem in Art. 6 and is left for the reader to supply. 

8. Base of a system of notation. In the discussion thus far, we 
have considered only the general case where the unit has been divided 
into n equal parts. When we come to introduce a particular system 
of notation, it becomes necessary to give n a definite value called 
the base of the system. Thus, in the decimal system, 10 is the 
base. The selection of a base determines the number of digits neces- 
sary and also certain laws of procedure in expressing numbers in that 
system. Thus, every removal of a digit one place to the right or left 
decreases or increases its value k fold if the integer k is selected as a 
base. We shall now show that any integer greater than one may be 
selected as the base of a system of notation for real numbers. 

Let A be any real number and k any positive integer greater than 
one. We shall show that we can express the number A in a system 
of notation having k as a base. In doing so, we shall make use of the 
geometric representation of real numbers by points on a straight line 
as a guide in selecting a suitable sequence to define A in the desired 
manner. Lay off from O the unit segment a sufficient number of 
times to finally obtain the interval in which the point A lies. If A 


O 1 2 3 A 


a See Sone ne a eee 
Qo a+1 
Ihiely SE 


is an end-point of this interval, then A is an integer. If it is not, the 
point A lies within the interval. Suppose it lies between points ao 
and a +1. Divide this interval into k equal parts. Suppose that as 
we proceed from dp we pass a of these divisions before we come to 
that one in which A lies. Divide this interval into k equal parts and 
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proceed as before, continuing the process indefinitely. The left end- 
points of the intervals in the sequence of intervals containing A repre- 
sent the numbers of the sequence 


Alay eee toto +e + 


k i es 


This sequence is regular and defines the number A in a system of 
notation having the base k. In such a system of notation there must 
be k digits. 

Suppose for example, k is equal to 3. We must then have three 
digits 0,1, 2. Every removal of a digit one place to the left increases 
its value threefold and likewise every removal one place to the right 
decreases its value threefold. If now we wish to change some number, 
say 14, expressed in the decimal system, to the system having the 
base 3, we write 14 as the sum of several numbers such that the 
digit in first place is 0, 1, or 2, the digit in the second place some 
multiple, not to exceed the double, of 3, in the third place a multiple 
of 9, etc; thus 

144=9+4+3+42. 
In the required system 2 is the same in both systems, 3 is represented 
by 10, and 9 by 100. Hence the required representation is 112. 


EXERCISES 
1. Determine which if any of the following sequences are regular: 
ae nenes ee oe te 


if 1. 1 
foe sie Seda ates sie ses 


Sythe Be aan dere 1 gst 
a ees | eres 
2,2+y2+at+ay tot sot Tay i 
eal 
jvc leo re ts Ea igs EOL ee 


V2 V2 v3 V2 V3 V4 
2. Find the limit of the following regular sequence: 


1 sige ‘ra es | 
i tat Be Mi te ace es tant ree 


3. Set up a generalization of the sequence given in Ex. 2 such that it shall 


represent the number = - a 
4. Is the number a = logy 5 a rational or an irrational number? 
5. Show that the sequence 
1.9, 1.99, 1.999, 1.9999, - - 
defines the number 2. Set up another regular sequence also defining 2. How 


many such sequences are possible? 
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6.. Show that the following sequence converges and defines an irrational 


yes 
numbe 1,1-} —344, —-44+4-h---- 


Hint: Compare with the expansion ! of log (1 + x) in a Maclaurin series. 

7. If {an} defines the number a, show that {| a, | } defines the number | a |. 

8. By the method employed in Art. 3 show that V5 is an irrational number. 
Is it also transcendental? 

9. Define addition of irrational numbers by the use of a partition of the 
rational numbers and show that the associative law of addition holds. 

10. Given the segment (0, 1) of a straight line. Divide this segment into 
three equal parts and drop out the middle part. Divide the remaining segments 
into three equal parts and drop the middle ones. Continue this process indef- 
initely. Show that the intervals thus formed may be arranged in sequences so 
that each sequence defines a single definite point. 

11. Show that every periodic decimal fraction is a rational number. 

12. The irrational number e may be defined as the limit as n becomes infinite 


of the sequence ;{ 1+ 2 - Prove the convergence of this sequence. 


13. Show that two regular sequences having an infinite number of elements 
in common represent the same number. 

14. Given the number 125 in the decimal notation. Represent the same num- 
ber in a numeral system having two as the base. 


1 See Townsend and Goodenough’s Essentials of Calculus, p. 307. 


CHAPTER II 
THEORY OF POINT SETS 


9. Infinite aggregates. In the preceding chapter we have had 
occasion to consider aggregates of numbers and of points on a straight 
line. Some of these aggregates, for example the regular sequences of 
rational numbers, contained an infinite number of elements. One 
may formulate the properties common to all infinite aggregates 
and, considered as abstract properties, they may be made the basis 
of rigorous mathematical discussions irrespective of the character of 
the individuals composing the aggregate.! A scientific statement of 
the principles which follow from the consideration of these prop- 
erties is of fundamental importance in mathematics and is known as 
the theory of aggregates. In what follows, however, we shall direct 
our attention to those properties which have to do with aggregates 
of points on a line or in ordinary space of two or three dimensions. 
Such a restriction of the general theory leads to the theory of point 
sets. If the set of points is confined to a line, we shall speak of it 
as a linear set. In a similar manner, we have a two-dimensional or 
a three-dimensional set if the points of the set are distributed over 
the plane, or in ordinary space. We shall also have occasion to con- 
sider sets of intervals and of regions. In the following articles we 
shall consider the general properties of linear sets. Later it will be 
pointed out how these properties may be extended to sets of two or 
more dimensions. 

We have seen that, assuming certain axioms, we may set up a 
one-to-one correspondence between the aggregate of all real numbers 
and the totality of points on astraight line. Consequently, while 
the discussion will often take a geometric form, nevertheless the sub- 
stance is always arithmetical, the geometric interpretation being a 
convenience rather than a necessity. As we shall see, a clear under- 
standing of the properties of point sets is of special value in discuss- 


1 The properties of infinite aggregates were first studied by Geo. Cantor in 


1871. See Math. Ann., Vol. 5. 
25 
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ing the nature of the limiting processes of analysis such as continuity, 
differentiation, integration, etc., and hence to the full understanding 
of the nature of functions themselves. 

In passing from the properties of finite aggregates to those of 
infinite aggregates, we must generalize the fundamental concepts and 
processes of mathematics and inquire whether the formal laws of 
arithmetic hold for these generalized notions. It becomes apparent 
at once that not all of those formal laws can hold for infinite aggre- 
gates. For example, in finite aggregates the whole is always greater 
than any of its parts; that is, we can never put the elements of a 
part of the aggregate into a one-to-one correspondence with the 
elements of the whole aggregate. This property does not hold for 
infinite aggregates. For example, the positive even integers can be 
put into a one-to-one correspondence with all of the positive integers. 
Likewise there exists a one-to-one correspondence between the 
positive integers and those positive integers divisible by three. In 
fact, the property that the elements of an aggregate may be put into 
a one-to-one correspondence with those of a part, is characteristic 
of all infinite aggregates and may be made the definition of such 
aggregates. 

10. Transfinite numbers. In elementary mathematics we say 
that a variable becomes infinite if it increases in absolute value with- 
out limit; that is, if its absolute value has no finite upper bound. 
For example, if n becomes infinite we understand that it may take 
any integral value however large, and we express that fact by writ- 
ing! m—>. It should be read ‘‘ n becomes infinite,” or “‘ increases 
without limit.”” The symbol © does not denote a definite number, 
and, in fact, it does not denote a number at all, but is a symbol 
used to express more conveniently a certain manner of variation. 
We do not say that m approaches ~, as we say that € approaches’ 0, 
if it decreases indefinitely in numerical value, for the reason that the 
symbol 0 denotes a definite number and ~ does not. 

There is, however, another use of the term infinity which comes 
into consideration in the higher branches of analysis. With Cantor, 
we shall assume that the sequence of all positive integers defines a 
number. Cantor called it the first transfinite ordinal number, and 
denoted it by w. This number w may be said to form a Dedekind 
partition between the class of all finite numbers and the class of all 
transfinite numbers. We shall not consider the properties of trans- 


Often this relation is denoted by writing n =~, 
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finite numbers, but wish merely to call attention to the possibility of 
their existence.! 

For finite aggregates, the reader is familiar with the distinction 
between ordinal numbers and cardinal numbers. The ordinal num- 
ber of such an aggregate is that number assigned to the last element 
in the process of counting. This number does not depend upon any 
particular order or arrangement of the elements. An infinite aggre- 
gate may not have a first element nor a last one. In many cases it is, 
however, possible to place the elements of an infinite aggregate in a 
definite order of arrangement, so that of any two elements we may 
say that the one precedes or follows the other according to some law 
of succession which enables us to say that if a precedes b and b pre- 
cedes c, then a precedes c. Two infinite aggregates having the same 
definite order of arrangement of their elements are said to have the 
same ordinal type if there exists a one-to-one correspondence between 
their elements such that their order is preserved; that is, if a; and 
a, are elements of the one set which correspond respectively to a,’ 
and a’ of the other set and a < ad (or a > ad), then a,’ < a,’ 
(a;’ >a’). Any set of elements which has the same ordinal type as 
the positive integers is said to have the ordinal number w. The ordi- 
nal number of infinite aggregates differs from that of finite aggregates 
in that it depends upon a definite arrangement of the elements and 
may vary if that arrangement is changed. Thus, if we rearrange the 
positive integers by taking first all of the even integers followed by 
all of the odd integers, the ordinal number is no longer w but w-2, 
since the ordinal number of the even integers and also that of the 
odd integers is w. 

Again, we need to generalize the notion of a cardinal number in 
speaking of infinite aggregates. By the cardinal number of a finite 
aggregate is meant the number of objects composing the aggregate 
irrespective of any order of arrangement; that is, it is the common 
property of all finite aggregates having a one-to-one correspondence 
with one another. We may likewise define the cardinal number of an 
infinite aggregate as the invariant property of the class of all aggre- 
gates whose elements can be put into a one-to-one correspondence 
with those of a given infinite aggregate. The cardinal number of an 
infinite aggregate does not depend upon any order of arrangement 
and is of course a transfinite number. We shall have occasion to 


1 For a discussion of transfinite numbers, see Hobson’s Theory of Functions of 
a Real Variable, Vol. I, Chapters II and IV. 
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compare the cardinal numbers of different infinite aggregates. Thus, 
any aggregate composed of the elements of a regular sequence has the 
same cardinal number as the set of positive integers, and is usually 
denoted by the symbol! a. The set of all real numbers has the car- 
dinal number of the set of points on a straight line, and as this is 
assumed to be continuous, we say that the set of real numbers has 
the cardinal number of the continuum, and denote it by the symbol c. 

11. Fundamental definitions. Among the simplest infinite sets 
are those whose elements may be put into a one-to-one correspondence 
with the positive integers. Such a set is said to be enumerable or 
countable. If such a one-to-one correspondence is not possible, 
then the set is said to be non-enumerable. A set composed of the 
elements of a regular sequence or of the terms of an infinite series are 
illustrations of enumerable sets. A set composed of a finite number of 
elements is also enumerable. 

A linear set is said to be bounded if its points all lie in a finite 
interval. Similarly, 2 two or three dimensional set is said to be 
bounded if its points all lie in a finite region. Thus the linear set 
oa ae A 
is bounded, because all of its points lie in the interval (0, 1). 

If the points of a set are so numerous in the neighborhood of a 
point a that in every interval (a — €, a + €) however small there are 
an infinite number of points of the set, then the point a is called a 
limiting point of the set. Thus, in the foregoing set, the point zero 
is a limiting point, since an infinite number of points of the set lie 
in any arbitrarily small interval inclosing the origin. We may also 
express this fact by saying that the given set is dense at the origin, or 
in the general case at the limiting point a. If every point of an inter- 
val is a limiting point of the given set, then the given set is said to be 
everywhere dense in the interval. Such an interval is characterized 
by the fact that no subdivision of the interval however small can be 
found which does not contain points of the given set. For example, 
the set of rational points is everywhere dense in any given interval; 
for, every point of the given interval is a limiting point of such a set. 

The aggregate of all the limiting points of a given set is called the 
first derived set. In a similar manner the limiting points of the first 
derived set constitute the second derived set, etc. 


1 Also denoted by Xo read ‘ Alef-null.”’ 
* The term ‘“ denumerable ”’ is also frequently used. 


1 
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We shall distinguish between a limiting point and a point of con- 
densation. By a point of condensation, we shall understand a point 
in every neighborhood of which there are a non-enumerably infinite 
number of points of the given set. It follows that every point of con- 
densation is a limiting point, but the converse is not true. If the 
points of condensation themselves have a limiting point, that point is 
itself a point of condensation, since every such point must have in 
every neighborhood of it a non-enumerable infinity of points of the 
given set. 

By the complementary set of a given set H, we mean the set ob- 
tained by omitting from the continuum the points of ZH. For example, 
the irrational points form the complementary set of the rational 
points. Ifa given set A contaizis the set EH as a subset, we may also 
speak of the complementary set of E relative to A, by which is meant 
that set of points obtained by omitting from the set A those points 
which belong to #. Unless otherwise designated, we shall use the 
term complementary set to mean the complement relative to the 
continuum. The set complementary to H is denoted by the symbol 
C(£). 

Any point of a set which is not a limiting point is called an iso- 
lated point. Every such point is characterized by the fact that it 
may be inclosed in an interval such that no other points of the set 
lie within this interval. It is possible to have an infinite set such that 
every point of the set is an isolated point. This is always the case 
if none of the limiting points of the set are themselves points of 
the set. Such a set is often spoken of as an isolated set. For ex- 
ample, the set 
Re as | 1 


Ae ags e dd 


er kak a : 


is isolated, since its only limiting point, namely zero, is not a point 
of the set. 

A point 2 is called an inner point of a given set H if it may be 
included in an interval (x — p, x + p), p ¥ 0, such that all the points 
of this interval are points of #. An inner point is also characterized 
by the fact that it is a point of # which is not a limiting point of 
the complementary set C(H). Thus, every point of a segment of a 
straight line other than the end-points is an inner point of the set 
composed of all the points of the segment. On the other hand, the 
set of rational points has no inner points. 

A point which can be inclosed in an interval containing no points 
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of the given set is called an exterior point. An exterior point is not 
a point of the given set but is an inner point of the complementary 
set. A point which is neither an inner point of the set nor an ex- 
terior point is called a boundary point of the set. The totality of 
such points constitute the boundary. A boundary point is also char- 
acterized by the fact that it is not an inner point of the given set 
E nor of the complementary set C(#). Such a point is either a 
point of H which is a limiting point of C(£) or a point of C(#) which 
is a limiting point of H. Thus if £# is the set of rational points in the 
interval (0,1), every point of this interval is a boundary point. 

A set which includes all of its boundary points is said to be closed. 
Such a set then contains all of its limiting points, and indeed a closed 
set might be defined as one which contains all of its limiting points. 
For, every boundary point is either a point of the set which is a limit- 
ing point of the complementary set, or it is a limiting point of the 
given set. Consequently, if all of the limiting points are included, 
all of the boundary points are included. The set of all real numbers 
in a closed interval is an illustration of a closed set. 

If every point of a given set is an inner point, then we shall call 
the set an open set.! Such a set therefore contains no boundary 
points. There are then sets which are neither closed nor open accord- 
ing to the foregoing definitions. For example, the set of rational num- 
bers is such a set. 

If, in addition to being closed, a set has the property that every 
point of the set is a limiting point of the set, then it is said to be a 
perfect set. All the points of a segment of a line is a simple illus- 
tration of such a set. 

By a continuum we mean any set which is everywhere dense and 
perfect. For example, the set of all real numbers or of the points of 
a straight line form a continuum. 

If it is possible to say of any three elements, a, b, c of an aggregate 
that if a precedes b and b precedes c, then a precedes c, the aggregate is 
said to be ordered. The points of a set may be ordered by the process 
of counting, or they may be arranged in order of magnitude, or by 
aid of any other suitable property. However, the question of order 
does not involve the necessity of arrangement by aid of any particular 
property. It does not involve the possibility of counting the elements 
and indeed there need be no first element of the set and likewise no 


* Some authors define an open set as one which is not closed; for example, see 
Young’s Theory of Sets of Points, p. 19. 
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last. Thus, the set of all the points on a straight line constitutes an 
ordered set although there is no first point, and as we shall see later, 
the points can not be enumerated. If there is a first element of the 
set and likewise of every subset, we say that the set is well-ordered. 

Two sets are said to be equivalent if they have the same cardinal 
number; that is, if they can be put into a one-to-one correspondence 
with each other. Thus the two following sets are equivalent: 


es ee 2 ie ye ane Seat) 
re SELES toe en 


It will be at once evident that all infinite enumerable sets are equiva- 
lent. 

If the points of a given set lie within a finite interval AB, the set 
is said to be bounded. We shall have occasion to speak of the upper 
and lower limits of a point set and likewise of its upper and lower 
bounds. Thus, if we have a bounded point set on the X-axis, we shall 
understand by its upper limit a definite point P such that there are 
points of the given set in every neighborhood of P but at most only 
a finite number of points of the set to the right of any such neighbor- 
hood. In other words P is the extreme right-hand limiting point of 
the given set. The upper bound of the set is its upper limit, in case 
no points lie to the right of P, or the extreme right-hand point of the 
set. Similarly, the lower limit of the given set is a definite point P 
such that points of the set lie in every neighborhood of P but at 
most only a finite number of points of the set are to the left of any 
such neighborhood. By the lower bound of the set is meant the ex- 
treme left-hand point of the set or the lower limit P, in case no points 
of the set lie to the left of P. The upper and lower bounds are some- 
times spoken of as the least upper bound and the greatest lower bound, 
respectively. That every bounded set has a least upper bound fol- 
lows from the fact that the numbers of the linear continuum can be 
divided into two groups; the first group containing those numbers 
greater than every number in the set, and the second group containing 
the numbers of the set and all numbers less than some or all numbers 
of the set. This partition of the linear continuum defines a real num- 
ber, which is the least upper bound. Similarly, the existence of the 
greatest lower bound may be shown. It will be seen that the upper 
and the lower limits are respectively the upper and the lower bounds 
of the first derived set; that is, the set composed of the limiting 
points of the set. 
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12. Fundamental operations with point sets. We shall have 
occasion to combine in one way or another two or more point sets 
into a single point set. In this connection it is necessary to define 
what is to be understood by the terms, sum, product, etc., of two or 
more point sets. We shall also inquire whether the formal laws 
of arithmetic hold for those operations. 

If we have given two point sets, H, and H2 such that L; is con- 
tained in Hz, we write 

EK, <i Es, or i. > Fi. 

By the sum of the point sets #1, H2,.. ., Hn, we mean the set E 
of all those points such that each appears in at least one of the given 
sets, and we write 

E= H+ Eo+-+--+ En. 
Although a point may appear in more than one of the sets H;, E., 

. , En, it is to be taken but once in the sum H. It will be seen that 
E is what is often called the logical sum of the given point sets.! 
The process of addition is commutative and associative as in ele- 
mentary arithmetic, thus 
E, + BE, = E,+H;, BE, + (224+ E3) = (#, + He) + Es = (Ei + Es) + Be. 

Given two sets LZ; and E2, the difference, H, — Ee, consists of those 
points of #; which are not points of H,. As one sees at once from 
this definition neither the commutative nor the associative law 
holds in general for subtraction. Moreover, by this definition sub- 
traction is not the inverse operation of addition for sets having com- 
mon points. 

The product of the point sets H,, H2,..., EH, is the set of points 
common to all of these sets; that is, it is the logical product of the 
given sets. If EH is the product we write ; 

Te DRA Ds Shock. or File 
The commutative, associative, and distributive laws hold for multi- 
plication as here defined; that is, 

EL, E, ee! Ee: Ey, 
(E,: E2)E3 = E,(E2: Es), 
E,(E2 35 Es) = E,- E, Se Ei: E’3. 

_ + See Whitehead and Russell, Principia Mathematica, Vol. I, p. 217. The sum 
is sometimes defined as the combination of two sets having no points in common, 
while the combination of sets having common points is called the union of the 
given sets. Cantor used the expression least common multiple instead of the 
union of the given sets. The union of sets having common points is sometimes 


denoted by S (Fi, Es, . . . ) to distinguish it from the sum. Instead of the term 
product as defined in the text the term greatest common divisor is also used. 
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The difference and the product of two point sets E,, Hz can be 
expressed as the sum of two point sets if we make use of the comple- 
mentary sets. For example, the complement of the difference of EF; 
and EH, is composed of the points of EH, and the complement of F, ; 
that is, we have 

C(E, — E2) = C(E,) + Eo. (1) 

From the definition of a product, it will be seen that the comple- 
mentary set of the product of #, and E; is the set of points not con- 
tained in both #, and #2; that is, it is the sum of the complementary 
sets of H, and Ey. We may then write 


C(E,: Es) = C(£i) + C(E2). (2) 


It follows from (1) and (2) that theoretically we need only consider 
addition and the taking of complements. It will frequently be more 
convenient, however, to make use of both subtraction and multipli- 
cation of sets. 

The foregoing discussion has to do with the arithmetical operations 
on a finite number of point sets. Later we shall see how these opera- 
tions can be extended and applied to an enumerably infinite number 
of sets. 

13. Sequence of point sets. We shall have occasion later to 
consider a sequence of point sets rather than the individual sets. 
Suppose we have given the sequence 

{E,} = Fi, Ee, - - Oa ees 

where each £, is itself a point set. The question presents itself 
whether such a sequence can have as a limit a definite set of points. 
In order that such a limit # shall exist, each point P of H must be a 
point of an infinite number of the sets H,. Moreover, the point P 
must occur in all of the sets H, after a certain one. We can best 
formulate the definition of convergence of a sequence of point sets 
{E,} by introducing what will be called a complete limit and a 
restricted limit of the given sequence. 

We shall understand by a complete limit of {H,} the set of all 
points such that each occurs in an infinite number of the sets H,. If 
we denote the complete limit by H., we may then write 


E, =(Fi+ BFe+ E3+---) (Hot Bs +-:-) (Bst+---)---3; @Q) 


that is, ZH, must contain the points common to the sum of all the 
given sets, the sum of all omitting the first, the sum of all omitting 
the first and second, etc. 
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The restricted limit of {H,} is understood to be the set of all those 
points which occur in every set H, after a certain one; that is, there 
must exist a value of 2 such that the points in question are contained 


in all the sets En, Enyi,.... If we denote the restricted limit by£,, 
we then have 
Eo = Eee Ee Hy 3 = ee eee (2) 


that is, ZH, must contain all of the points common to all of the sets 
E,,, likewise those common to all except Hi, those common to all ex- 
cept H,, Hz, those common to all except Hi, He, Es, etc. 

It follows that all points of H, are likewise points of H.; that is, 
E,is contained in E,. When EH, and E, are equal, the given sequence 
{H,} is said to converge to unique limiting point set. A sequence 
{E,} does not necessarily converge, but if it does we may write 

L E,= E, = HE, = E. 


no 


From the foregoing definitions it will be seen that the complete 
limit of the sequence { #,,} is the complementary set of the restricted 
limit of the sequence of complementary sets C(#;), C(H2),- - -. 

As an illustration of a convergent sequence of point sets, let us 
consider the sequence { Z,,}, where 


Hy a Hys 2 eh see (3) 


and it is assumed that H, contains elements; that is, it is not a null 
set. Every point of any Z, is then contained in all the sets of the 
sequence which follow. Hence EF, and E, both exist and £, is not 
a null set. Moreover, the two limits are the same. Consequently, 
the limit exists and we have 

LE, =F, +E,+++-+hHat+-- 


As another illustration of a convergent sequence, consider the 
sequence { H,,}, where 
By ee se eo i ree ee (4) 


Each £,, contains all the sets that follow. Again HZ, may be different 
from the null set, in which case E, also exists and the two are equal. 
We, therefore, have the result 

lp Ee = Big noe eee 


nto 
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Let us now consider any sequence { Z,} of point sets. Set up the 
auxiliary sequence {A,}, where 


A,= M+ Het+- +--+, 


From the first of the above illustrations the sequence {A,} has a 
limit, and hence we may write 


B,+E,++- +++ +: - Ser es He) 
In a similar manner, if we put 
B, = (E,: E2- Cees - Ep), 
the sequence {B,} has a limit by the second of the above illustrative 
examples. We then have as a result 
Siete ae nora Ny ee F/O (Ry He ees HS) (6) 


no 


From the definition of a complete limit and of a restricted limit 
respectively, it is evident that we may write for any set {Z,} 
po bet Weta f° = +); Bs G (BysHaa > +). (7) 


14. Properties of derived sets. The existence of limiting points 
of an infinite set is established by the following theorem. 


TuHeEorEM I. An infinite set of points inclosed in a finite interval has 
at least one limiting point. 


Suppose the given set of points £ lies in the finite interval (a, 6). 
Divide this interval into two equal parts by the point 2. Of these 


Fig. 4. 


two parts at least one, say (2, b), must contain an infinite number 
of points of the given set. Divide the subinterval (x, b) into two 
equal parts by the point x2. At least one of the intervals (a, 22), 
(v2, b) must contain an infinite number of points of #. Suppose 
(1, 22) to be the one. Divide this subinterval into two equal parts 
by the point 23 and proceed as before. Let this process of subdivision 
be carried on indefinitely. We thus obtain an infinite sequence of in- 
tervals J, such that each lies within the preceding one and the length 
of I, approaches zero as n becomes infinite. By the theorem of Art. 7, 
this sequence defines a definite limiting point z. In every neighbor- 
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hood of xo, however small, there exists an infinite number of points 
of the given set. The point is, therefore, a limiting point of the set. 
There may be other limiting points, but the theorem shows that there 
must be at least one. 

In most of the illustrations thus far given, the infinite sets of points 
have but a single limiting point. That there may be more than one 
limiting point is illustrated by the following examples. 


Ex. 1. Consider the limiting points of the set, 

Sita 

This set has the limiting point 0 and also the limiting point 3; for, the subset, 
af ak al 

ug ae 

is dense at the origin, and the subset 


Lil 
AY 


1 


1 


Lane, 
2 ak 
is dense at 4. 


Ex. 2. Find the limiting points of the point set 
die / \eek in’ ANte 1\3 1\2 1\3 nes yh 1\4 
1 y G)> 3+) G)’ 3+ G) G) + G) G) a+) 
IN 1 INE NG 1\6 
(3) +G) G)+G) G)- 
From inspection, it will be seen that this point set has an infinite number of 
limiting points, namely: 
9. 2 () ae 
BEAD MOA OP 


As we have seen, the limiting points themselves constitute a point 
set called the first derived set. If H is the original set, then the de- 
rived set is denoted by H’. If EH’ is composed of an infinite number 
of points lying within a finite interval, then it also has one or more 
limiting points and these points constitute the second derived set, 
which is denoted by E’’. The point set considered in Ex. 2 has two 


derived sets, namely 
a 7 ; (5) (3) 
»9’ \9 z 9)? re ate) 
0. 


‘tr 


If £’” had contained an infinite number of points, we should have had 
a third derived set E’’’, ete. 

If but a finite number of derived sets exist, the given point set is 
said to be of the first species. A point set may, however, have an 
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infinite number of derived sets, and in this case it is said to be a set 
of the second species. The set of all rational numbers in the interval 
(0, 1) is an illustration of a point set of the second species. In this 
case, the first derived set contains all the real numbers in the given 
interval, and each succeeding derived set is identical with the first. 
We have the following theorem concerning derived sets. 


THEOREM II. Every derived set is closed. 


Let E be the given set, and let us assume that E’ is not closed. 
Then there exists a limiting point 2 of EZ’ which is not a point of E’. 
In every neighborhood of x there are then an infinite number of 
points of #’, and each of these points is, therefore, a limiting point 
of #. Hence, in every neighborhood of 2x there exist an infinite 
number of points of #, and x) must then be a limiting point of HE and 
consequently a point of H’, which is contrary to the assumption 
that H’ is not closed. From this contradiction the theorem 
follows. 

15. Properties of enumerable sets. The simplest infinite point 
sets are those whose elements can be placed in a one-to-one corre- 
spondence with the positive integers, namely enumerable sets. The 
division of infinite point sets into enumerable and non-enumerable 
sets is of great value in discussing many of the important questions 
arising in analysis and in geometry. Such a point set may be so 
arranged as to be well-ordered and the elements distinguished from 
one another by means of subscripts. 

Any subset of an enumerable set is also enumerable, and if a finite 
set is added to an enumerable set the sum is enumerable. Moreover, 
every enumerable set can be decomposed into an enumerably infinite 
number of subsets each of which consists of a single point or a finite 
number of points. Further properties of such sets are given by the 
following theorems. 


TueoreM I. The sum of an enumerable set of enumerable sets is 
itself an enumerable set. 
Given the enumerable sets 
FE, Ee, - . Pee 3 ° os 


each of which consists of an enumerably infinite number of points. 
We are to show that the sum £ is also enumerable. The elements 
E,, may be written as follows: 
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E, = Eu, Exe, Eis, + + * 5 
E, = En, E22, Ex, ne ae hay 
E; = Eu, Ese, Ess, * * * » 


En <a En, Ene, Ens amas 57 
We shall now select the elements of # from this array in such a 
manner that the sum of the subscripts shall constitute a monotone 
increasing sequence. This may be done by taking first the element 
the sum of whose subscripts is 2, followed by those whose sum is 3, 
then by those whose sum is 4, etc. What is the same thing, we may 
select them in the order indicated by the arrows in the following 
arrangement. 


Be Eve Eg Ee 


The resulting arrangement of EF gives 
E= En, E,2, Ex, Ex, Ex», E\s, Ex, so eirscy 
i) J J ome 1 4 
ly 25 35 4) By 6) 7) ate ee 
where the elements stand in a one-to-one correspondence with the 
positive integers as indicated. The set H is therefore enumerable 


as the theorem states. 
We have the following corollaries. 


Cor. I. The sum of a finite number of enumerable sets or the sum 
of an enumerable set of finite sets is enumerable. 
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This corollary follows at once from Theorem I, since every finite 
set is enumerable, and we then have an enumerable set of enumerable 
sets. 

It follows from this corollary that if an enumerable set is sub- 
tracted from a non-enumerable set, the resulting set is necessarily 
non-enumerable; for, otherwise it would be possible to add two 
enumerable sets and obtain a non-enumerable set. The difference 
of two non-enumerable sets may, however, be either enumerable or 
non-enumerable. 


Cor. II. The set of rational points on a line is enumerable. 


The rational points correspond to the set of rational numbers. 
Every rational number can be written in the form - where p and ¢ 


are each integers. The set of values which can be assigned to p or 
to qis therefore enumerable. There is then an enumerable set of such 
fractions having a given numerator, and since there are an enu- 
merable set of values which can be used as numerators, it follows 
that the set of all rational numbers constitutes an enumerable set of 
enumerable sets and hence is, by Theorem I, enumerable. 

It is to be observed that the rational numbers when arranged in 
order of magnitude can not be put into a one-to-one correspondence 
with the positive integers without disturbing the order of arrange- 
ment. When arranged in this manner, there is no next one following 
a given number; for, as we have seen, there is always an infinite 
number of rational points between any two given rational points. 
What the theorem asserts is that it is possible so to arrange the 
totality of all rational numbers that they are in a one-to-one order- 
preserving correspondence with the positive integers, and from this 
fact it follows that they constitute an enumerable set. 

It has been pointed out that the set of rational points is every- 
where dense, and we now see that in spite of that fact the set is 
enumerable. It does not follow that the set of all points on a straight 
line is enumerable. The fact that such a set is not enumerable is 


shown by the following theorem. 
, Tueorem II. The linear continuum is a non-enumerable set. 

we: Due to Cantor (1873). This paper is said to contain the first instance where, 
in dealing with infinite sets, there was need to make use of different cardinal 


numbers. 
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Without loss of generality, we can consider the points of the inter- 
val between zero and one; for, if the set of points between 0 and 1 
is non-enumerable, then the same is true for the entire linear con- 
tinuum. We shall assume, therefore, that the numbers corresponding 
to the points of the open interval (0, 1) form an enumerable set and 
show that this assumption leads to a contradiction. Let these num- 
bers be denoted by 

Pi Ps, Pape ee egy 2 ae (1) 
Each of these numbers can be expressed as a decimal fraction having 
an infinite number of terms. In case the decimal is terminating, there 
are two ways in which it can be so represented. Thus the fraction 
three-tenths can be written either 


O:3000' == 708: 0.2999 eee 


To make the representation definite and uniform, we shall write all 
the terminating decimals with a continuation of ciphers after the 
last significant figure. The numbers given in (1) may then be written 


Py, = 0. Qi Qh, Q3 * ee a 8 Seg? mee aa 
Po, = 0. G21 Q22 23 + eT 8 Oy ae AO ac 
Ps = 0. Qt31 Ots2 O33 > * * Asn * * y (2) 


Py, = 0. Qtyr Ope Ong * + + kn: * ma) 
where each symbol a@;,, in this array represents some one of the digits 
OO 122, 5, 4575, 0; Ward, oF 

We now set up the number 
P =0. a) Q2 3° *. 8 5 3S V ang 


where a; is any of the foregoing digits different from a, 2 is any one 
different from a22, a3 different from a3, etc., in general a, is any digit 
different from Qnn, each digit being taken different from 9. We have 
thus a decimal fraction, and hence P lies in the interval (0, 1). How- 
ever, the number P is different from any number P, given in (2), 
since it differs by at least one digit from each one of them. Conse- 
quently, the assumption that the numbers given in (1) correspond 
to the totality of points in the interval (0, 1) is wrong, since the num- 
ber P also corresponds to such a point. Hence, the set of all points 
in (0, 1) is not enumerable. 
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TuroreM III. The set of all irrational points on a line is non- 
enumerable. 


From Theorem II, the set Z; of all points on a line is non-enumer- 
able, and by Theorem I, Cor. II, the set H2 of rational points is 
enumerable. If we subtract an enumerable set from a non-enumer- 
able set the resulting set is non-enumerable. Hence, EZ, — Fz is 
non-enumerable as the theorem states. 

From this theorem it follows that there are many more irrational 
points than rational points ina continuum. As the rational and irra- 
tional points are everywhere dense, it follows that a set of points 
which is everywhere dense may or may not be enumerable. 


THeoreM IV. If we have given on a straight line a set of non-over- 
lapping intervals, then the set is enumerable. 


About any point 2» of the given line draw a circle of unit radius. 
The intervals in question may be very small, but they are always dif- 
ferent from zero. Since the lower limit of the lengths of the intervals 
may be zero, it is possible that an infinite number of these intervals 
may lie within the circle. However, as the diameter of the circle is 
equal to two, only a finite number of intervals of length equal to or 


greater than 3 can lie within the circle, whatever finite value be 


assigned to n. Thus there are a finite number having a length be- 
tween 1 and 3, a finite number of length between 4 and 3, between } 
and 3, etc. The intervals lying within the circle must then form at 
most an enumerable set of finite sets and hence must be enumerable. 
To show that the set of intervals exterior to the circle is also enumer- 
able, subject the given line to geometric inversion with respect to the 
given circle. By this process all of the non-overlapping intervals 
lying exterior to the circle become non-overlapping intervals within 
the circle. The set of all such intervals within the circle form at most 
an enumerable set, as we have seen. It follows that the set of all non- 
overlapping intervals on the given straight line must be enumerable. 


Cor. Every isolated set of points is enumerable. 


Each point of the given set # is an isolated point and hence can 
be inclosed in an interval containing no other point of the set. If 
any two of these intervals overlap, one or both may be shortened so 
that the intervals merely abut. The given set of points is then in- 
closed in a set of non-overlapping intervals, which is enumerable by 
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the foregoing theorem. As each interval contains but one point of 
the given set E, it follows that E is also enumerable. 


TuroreM V. A set, bounded or not, containing no point of condensa- 
tion of the set, is enumerable. 


Denote the given set by H, and consider the sequence of values 


iy eb ee 1 

eee eee (1) 
The entire line upon which £ lies can be covered by an enumerably 
infinite set of non-overlapping intervals of length less than, or at 


most equal to, + n= 1, 2,3,---. Aswe shall see, these intervals 


may be used to divide # into an enumerable set of subsets Hi, Ep, 
“oh Big ee oe 
Put into £;, all those points of # which can be inclosed in a set of 
non-overlapping intervals of length 3 such that each interval contains 
only an enumerable subset of H. Put into E; all those remaining 


points of H which can be inclosed in a set of non-overlapping intervals 


of length > each interval likewise containing only an enumerable 
subset of H. In general, put into £, all of those remaining points of 


E which can be inclosed in intervals of length * such that the inter- 
vals do not overlap with one another nor with those previously used, 
and each contains only an enumerable subset of H. There is thus 
associated with each number given in (1) at most an enumerable 
set of non-overlapping intervals. 

Since no point of the given set E is a point of condensation, it is 
possible to assign all of the points of # to some subset H,. Hence, 
we have all of the points of H# included in the enumerably infinite 
number of enumerable subsets H;, H2,- - -,H,,+ + +, and con- 
sequently E itself is enumerable by Theorem I. 


THEOREM VI. A non-enumerable set EH is composed of an enumer- 
able set A and another set B, each point of which is a point of conden- 
sation of B. 


The points of condensation of a subset are at the same time points 
of condensation of the given set. If we remove from £ its points of 
condensation, the remaining subset A can have no points of conden- 
sation which are points of A, and hence by Theorem V it must be 
enumerable. Since the subset B where, B = E — A, differs from EH 
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only by an enumerable set A, it follows that EZ must contain the same 
points of condensation as B. Hence, the set B is not only composed 
of the points of condensation of H, but each point of B is also a point 
of condensation of B. We have, therefore, 

E=A+B, 
where A and B possess the required properties. 


TueEoreM VII. [f the first derived set E' is enumerable, the original 
set E 7s also enumerable. 


The product #-£’ is the set of points common to the sets E and 
E’. The set H-E’ is enumerable, since it is a subset of the enumer- 
able set #’. The set A =E-(E-E’) 


is composed of isolated points, and hence is enumerable. The set 
E=A+(E-E’) 

is the sum of two enumerable sets and is therefore enumerable, as the 

theorem states. 

As every derived set is closed, there exists for a set EH of the second 
species certain points which are common to all the derived sets E™, 
no matter how large n may be taken. These points form a closed set 
which we shall denote by E®), where w is the first transfinite ordinal 
number. We may then state the following theorem. 


THEOREM VIII. Every set of the first species, and those of the second 
species for which the derived set E® is enumerable, is itself enumerable. 


In case the set is of the first species, there exists a number r such 
that the r” derived set E™ contains only a finite number of points. 
Moreover, each of the sets 

GB), 8), (a) — Be) (1) 
is isolated since each is formed by removing from a point set its limit- 
ing points, that is its derived set. Each of these subsets is therefore 
enumerable by the corollary to Theorem IV. 

In the case of a set of the second species, we have the enumerably 
infinite number of sets 

GF 8"), (Bi — Ble s+, (BO — BO), +) 
plus the enumerable set H#™. Here again each of the sets is enumer- 
able. In the first case we had a finite number of enumerable sets, 
and in the second case we have an enumerably infinite number of 
enumerable sets and hence in either case the sum LH’ is enumerable. 
Consequently, by Theorem VII the given set H must be enumerable. 
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16. Open and closed sets. It follows from the definition of open 
and of closed sets that the complementary set of a given set is open 
or closed according as the given set is closed or open. Likewise, the 
sum of any number of open sets is an open set; for, an inner point of 
any of the given sets is an inner point of the combined set. It also 
follows that the product of any number of open sets is an open set, 
if not a null-set. Similar statements can be made concerning closed 
sets. Other properties are stated in the following theorems. 


TurorEeM I. The points of condensation of a given set form by 
themselves a closed set. 


Let E be the given set and E, the set composed of the points of 
condensation of #. Then any limiting point P of H; must have an 
infinite number of points of EH; in every neighborhood of it. But 
each point of EH, is a point of condensation of H and hence has a 
non-enumerably infinite number of points of # in every neighborhood 
of it. Consequently, in every neighborhood of P there must exist 
a non-enumerable number of points of H. The point P must then 
be a point of condensation of HE and hence is itself a point of EF). 
However, P is any limiting point of H;. Consequently, #; contains 
all its limiting points and is therefore closed. 


THEOREM II. Let E be any open point set. Then E can be ex- 
pressed as the sum of a finite or enumerably infinite set of non-over- 
lapping open intervals. 


As the given set E is open, any point P of it can be included in an 
interval 6 every point of which is a point of H. The intervals 6 may 
be so selected that the end-points of 6 are not points of H but of the 
complementary set C(#). Because of this fact, the intervals 6 may 
be assumed to be non-overlapping. From Theorem IV of the previous 
article, it follows that the intervals 6 form at most an enumerable 
set. Consequently, the given point set E is the sum of either a finite 
or enumerably infinite number of non-overlapping open intervals and 
the theorem is thus established. 

We have the following important theorem, known as the Heine- 
Borel theorem.! 


1 Borel stated the theorem for the case of an enumerable set of intervals. The 
theorem was extended by Lebesgue to the more general case. See Borel, Lecons 
sur la Théorie des Fonctions (1914) p. 42; also, de la Vallée Poussin. Intégrales 
de Lebesgue, p. 18. 
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THEOREM III. Given a set of intervals {I} such that each point of a 
gwen closed interval (a, b) is an inner point of at least one of the inter- 
vals I. We may then select from the set of intervals {I} a finite number 
having the same property; namely, every point of (a, 6) is an inner point 
of some one of them. 

This theorem is equivalent to saying that if a given closed interval 
can be completely covered by any set of intervals, it can also be 
covered by a finite set. A set of intervals {J} is said to cover the 
interval (a, b) if every point of (a, b) is a point of some J. 

To prove the theorem it is sufficient to divide the given interval 
(a, 6) into a finite number of consecutive parts, each of which lies 
within some interval J. For example, let (a, 6) be divided into 2” 
equal parts. We shall show that there exists a finite value of n such 
that each subdivision lies within some interval J. Let us assume that 
the contrary is the case and show that this assumption leads to a con- 
tradition of the hypothesis. Under this assumption there must exist 
for each n a subdivision 6, which does not lie within any J no matter 
how large n be taken, and hence we have a sequence of such intervals 
{6,} each lying with the preceding one. As n increases, the length 
of 6, grows smaller and gives rise to a sequence of values having the 
limit zero. Let P, be any point in 6,. We then have for increasing 
m an infinite set of points, which must have a definite limiting point. 
This limiting point P must lie in each interval 6,. As the points of 
6, do not lie within any J interval, it follows that P can not be an 
inner point of any J. This is impossible, since by hypothesis P is a 
point of (a, b) and hence must be an inner point of some J. 

As a consequence of the foregoing theorem, we have the following 


corollary. | 
Cor. If we can cover the whole of an interval (a, b) by the aid of an 


enumerably infinite set of intervals {I,,}, then the sum of the lengths of 
these intervals is at least equal to (a, b); thats, 


> (Length of In) 2b -a. 


The Heine-Borel theorem may be stated in a more general form 
for a closed set of points as follows. 


TuHEorEM IV. Given a set of intervals {I} such that each point of 
a given bounded, closed set of points E is an inner point of at least one of 
the I intervals, then it is possible to select a finite number of the I intervals 
such that each point of E is likewise an inner point of some one of them. 
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In some discussions this form of the theorem will be found more 
convenient than that given in Theorem III. The proof is essentially 
like that given for Theorem III. 

It can be shown that the foregoing theorem holds if the set of 
intervals {J} is replaced by an aggregate of open sets.!_ The Heine- 
Borel theorem can also be extended to two or more dimensional sets. 

17. Perfect sets. As already stated, a perfect set contains its 
own limiting points and every point of the set is a limiting point of 
points of the set; that is, the set is closed and dense in itself. The 
set of all real numbers is an illustration of a perfect set. Among the 
properties of perfect sets are those given in the following theorems. 


TuHEorEM I. A perfect set is identical with its derived set. 

This theorem follows at once from the definition of a perfect set. 
Since the given set # is dense in itself, it can contain no points which 
are not at the same time points of the derived set H’. Moreover, as # 
is closed, all of the limiting points, that is all of the points of #’, are 
also points of H. Hence, # and EL’ are identical as the theorem states. 

It is to be noted that a perfect set can have no isolated points. 

Cor. A perfect set is identical with any one of its derived sets. 

This result follows directly from Theorem J; for, if the derived 
set H’ is identical with HE, then E’ is also a perfect set and must be 
identical with its first derived set E’’, etc. 

TuHeEoreEM II. Jf a set E is dense in itself, then its first derived set 
E’ is perfect. 

Denote by A the set of limiting points of E which are not included 
in H. Then the set B given by 

B=EH+A 
is a perfect set, since it is not only dense in itself but contains all of 
its limiting points. By Theorem I it follows that 
Bit Bhi 
Hence, LH’ is also perfect, since it is identical with B. 

TuroreM III. The povnts of condensation of a given non-enumerable 

set form by themselves a perfect set. 


By Theorem VI, Art. 15, it follows that the given set EH can be 
decomposed into two subsets, A which is enumerable and B of which 


1 See de la Vallée Poussin, Intégrales de Lebesgue, p. 112. 
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each point is a point of condensation of B. The points of condensa- 
tion of E form a closed set by Theorem I, Art. 16, and consist of the 
points of B plus their limiting points. However, every point of B 
is a limiting point of B, and hence the points of condensation of E 
constitute the derived set B’. As B is dense in itself, B’ is also, and 
moreover B’ is a closed set. Consequently, B’ is a perfect set, and the 
theorem follows. 

Since a perfect set contains its own limiting points and each 
point of the set is such a point, one might infer that the set must be 
everywhere dense. This, however, is not true as shown by the fol- 
lowing illustration. 

Consider the interval (0, 1). Divide this interval into three equal 
parts and drop out the middle third, which we shall designate by 6,. 


Oo 62 OF l de n q 
Biased: 


Divide each of the two remaining portions likewise into three equal 
parts and drop out the middle third. We shall denote each of the in- 
tervals thus dropped by 62. Divide each of the four remaining inter- 
vals into three equal parts and as before drop the middle third in each 
case. Continue this process indefinitely. Let the set H be the end- 
points of the set of intervals {6,} dropped together with the limiting 
points of these end-points. 

It follows from the manner in which points of E are selected that 
each point is a limiting point of the set. The given set is then dense 
in itself. Moreover, it is also closed, since by definition # contains all 
of its limiting points. Hence, £ is a perfect set. 

However, this set of points is not in any subinterval everywhere 
dense; for, at each point of H which is an end-point the points of # 
are dense on only one side. Moreover, in the neighborhood of a 
limiting point of such end-points there is a portion free from points of 
E because of the fact that it is a limiting point of end-points. 


TurorEM IV. Every linear perfect set which is in no interval every- 
where dense consists of the end-points of an enumerable set of non-over- 
lapping intervals together with their limiting points, and conversely every 
set of points so defined is a perfect set. 


As the given set E is closed, there are two points of the set which 
are the extremities of the segment J, within which # must lie. The 
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complementary set {c} = C (Z) is an open set and by Theorem II, 
Art. 16 can be expressed as the sum of an enumerable set of non- 
overlapping open intervals {6,}. We shall speak of the open intervals 
5, as the free intervals, as they contain no points of H. Since £ is in 
no subinterval of J everywhere dense, it follows that in every sub- 
interval of I there are points of {c}. There are then intervals 6, 
which lie wholly or partly within each subinterval of 7, and con- 
sequently the set of intervals {6,} is everywhere dense. Since every 
point c of the complementary set C (Z) is a point of one of the free 
intervals 6, and these intervals are everywhere dense, it follows that 
the points of EZ consist of the end-points of the intervals 6; and the 
limiting points of such end-points, as the theorem requires. 

The converse of the given theorem may be readily established, and 
is left for the reader to supply. 


TuEeorEeM! VY. A linear perfect set has the cardinal number of the 
continuum. 


Let us consider the most unfavorable case; namely, where the 
given perfect point set # is in no subinterval everywhere dense. If 
we establish the theorem for this case, it holds for all other cases. 

We shall first show that to each point of H there may be made to 
correspond one and only one point of the continuum. By Theorem 
IV, the set # consists of the end-points of an enumerable set of non- 
overlapping intervals {6,} together with their limiting points. As in 
the proof of that theorem, these intervals may be so chosen as to be 
everywhere dense in the interval J containing H. In the interval J 
let us consider also an enumerable, everywhere dense set of points X 
so situated that any two points have the same relative position as 
the corresponding intervals. 

Let / be the largest 6; interval in J. We have then 


where 6,’ is the interval to the left and 6,’ the one to the right of 1. 
Denote by ly the largest 6; interval in 69’ and by J; the largest 6; inter- 
val in 6;’.. We may then write 


1 See Cantor, Math. Ann. Vol. 23, p. 480. 
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80 = O60 + lo + 61, 

OY = 6 +h +6, 
where 690, dio are to the left of h, h, respectively, and 6/,, 5/, are to 
the night. Continue indefinitely this process of subdivision of the 
6’ intervals. Consider any sequence of intervals of the type 


{ Ox} = On, Ose; DS eee) Ons a taal (1) 


selected from the 6’ intervals. The digits p,q,7, - - - are either 0or 1. 
Let zy be any point of Xin the interval 6f. There is then associated 
with the sequence of intervals (1) a sequence of points, namely 

{tw} = Xp, pq, Tpqr,* * + An, + * (2) 
Each interval 6x lies in the preceding one and has one end-point in 
common with it. Moreover, the lengths of these intervals approach 
zero as a limit, and consequently (1) determines uniquely a point 
which is either one of the end-points of a 6; interval or a limiting point 
of those end-points, according as the digits in the subscript 

N=pqr-- 

are or are not ultimately all 0’s or all 1’s._ But, as already pointed 
out, the end-points of 6; together with their limiting points constitute 
the given set EH, and consequently every point of # is the limit of 
some sequence {6x}. On the other hand, the corresponding set of 
points {zy} has as a limiting point a definite point P of the continuum. 
Hence, to every point of H corresponds one and only one point of the 
continuum. 

In order to complete the demonstration, we must show, con- 
versely, that to each point of the linear continuum there corresponds 
one and only one point of the given perfect set H. To do so, con- 
sider again an enumerable set of points X = {a;} which is everywhere 
dense in the given interval J. Consequently, the first derived set X’ is 
identical with the continuum. For convenience, we shall put 

Me a XA 7, 
where X; denotes those limiting points of X not contained in X. The 
points of every convergent sequence {,} selected from {x,} can be 
written in the form {zx} given in (2); for, all one needs to do is to ex- 
press the numbers 7 in a dyadic number system. The limiting point 
xz’ is then a point of X or of X:, according as the digits in 


N= pqr::-: 
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are or are not ultimately all 0’s or all 1’s. However, the sequence 
{zx} may be made to correspond to the sequence of intervals {6,} 
having the same subscripts. 

As we have seen, the sequence {zx} determines a point x’ which is 
either a point of X or a point of X;. In the first case, it corresponds 
to an end-point of one of the intervals 6;, and in the second to a 
limiting point of such end-points. Hence, to each point x’ of the 
continuum there must correspond one and only one point of £. 
With this conclusion, the demonstration is completed. 

The foregoing theorem has some important consequences, among 
which is the following corollary. 


Cor. A perfect set can not be enumerable and conversely. 


By Theorem II, Art. 15, the continuum is non-enumerable. Since 
we have now shown that the points of any perfect set have a one- 
to-one correspondence with the points of the continuum, it follows 
at once that a perfect set is also non-enumerable, in spite of the 
fact that these points may not be in any subinterval everywhere 
dense. 

The converse also follows from the foregoing theorem; for, if 
the given set is enumerable, it cannot be put into a one-to-one cor- 
respondence with the points of the continuum and can not be perfect. 


TueorEeM VI. A closed set is either enumerable, or 1s composed of 
an enumerable set plus a perfect set. 


If the given set H is non-enumerable, then by Theorem VI, 
Art. 15, it follows that it is composed of an enumerable set plus a 
set B, every point of which is a point of condensation. However, 
E is closed and hence contains all of its own limiting points and 
consequently all of its own points of condensation. But by The- 
orem III, the points of condensation of a non-enumerable set form 
by themselves a perfect set. Hence, B is a perfect set and £ is either 
enumerable or composed of an enumerable set and a perfect set, as 
the theorem states. 

18. Point sets of the first and second category. Consider an 
enumerable set of point sets 


Ay, Aa; Ass ar eee Gy (1) 


each of which is in no part of a given interval or region everywhere 
dense. The set of points # formed by the sum of the sets (1), namely 


Be Ay Ag ena eee, (2) 
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is said to be a set of the first category. Each point of such a set is 
then a point of at least one of the sets in (1), but no point is taken 
more than once in making up the set E. Every set which is not of 
the first category is said to be of the second category. 

The set of all rational points in any interval (a, b) form a point 
set of the first category. For, we may take as A, all of those frac- 
tions having n as the denominator. Since all rational numbers may 


be written in the form P it follows that the set EH defined by (2) is 


composed of an enumerable set of point sets, each of which is not 
everywhere dense in any part of (a, 6). 

The following theorems, while discussed with special reference to 
linear sets, hold also for two dimensional sets. 


THEOREM I. Every enumerable set is of the first category. 


It follows from the fact that the given set is enumerable that it 
can be represented as the sum of an enumerably infinite number of 
sets, each of which consists of a single point. Since this is true, the 
given set satisfies the definition of a set of the first category. 

The converse of this theorem is not true; that is, there are point 
sets of the first category which are non-enumerable. The following 
illustration shows that sets of the first category exist which are not 
only non-enumerable but also everywhere dense in a given interval 
and moreover have the cardinal number of the continuum. 

In Art. 17 it was shown that we may have in the interval (0, 1) 
a perfect set which is in no subinterval everywhere dense. The perfect 
set was defined as the end-points of a set of intervals {6,}, together 
with their limiting points, obtained by dropping the middle third of 
the successive intervals. Let H, denote the point set thus obtained. 
Consider now each interval 6, and treat it in precisely the same man- 
ner that the original interval was treated. In this way we obtain 
a new set of points which added to FZ; constitute a perfect set which 
we shall denote by H:. Treating in the same way those remaining 
intervals whose inner points are not points of H, and continuing the 
process indefinitely, we have a sequence of perfect point sets 


Heel rics, Ba ics” 
each of which includes the previous one, and none of which is every- 


where dense in the given interval (0,1). The sum of these point 


sets, namely 
B=, + Bots ++ +Eaters, 
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is therefore a set of the first category. The resulting set H# is, how- 
ever, everywhere dense in (0, 1); for, in H, the maximum distance 


between points of the set is , in £ it is S in £, itis » etc. Hence, 
as n takes increasing values this maximum distance decreases and 
becomes arbitrarily small. Since LH, is a perfect set for each value 
of n, it follows that E is also a perfect set. By Theorem V of Art. 17, 
it follows that H has the cardinal number of the continuum, and 


hence can not be enumerable. 

THEOREM II. The sum of a finite or enumerably infinite number 
of sets of the first category 1s a set of the first category. 

Let the given sets whose sum is to be considered be 

Ey hy By > eo eae 

Each of these sets is assumed to be the sum of an enumerably infinite 
set of other sets, each of which is in no part of the given interval 
(a, b) everywhere dense. The sets HE; may be represented respec- 
tively as follows: 


Hy = Ag + Aw Ais: = = A er 

Hig = Ay + Aca Ao + 80s): 4 ae a, 

Es = An + Ase + Ast: +++ Hates :, 

Ey, = Ai + Ane + Aig + + Aint > 
We now put 


By x Aun, Be = Ax, B; S Aa, By = A31, a a 

B, being one of the elements Amn, k = m+n, chosen in the same 
order as in the proof of Theorem I, Art. 15. As each B; is in no part 
of the interval (a, 6) everywhere dense, the sum of all of the B’s, 
that is B= Bt Byte be 
satisfies the definition of a set of the first category. 

We have seen that a point set of the first category may be every- 
where dense. The complementary set is always everywhere dense 
as shown by the following theorem. 


TuHerorEM III. Jf EF is a set of the first category in the interval 
(a, b), then C(E) is everywhere dense in (a, 6). 


The given set E is formed from an enumerably infinite number of 
sets Ay Ag ko Ae ee 
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each of which is in no part of (a, 6) everywhere dense. It (ao bo) is 
any subinterval of (a, 6), it then follows that there is some portion 
Of (ao, bo), say (a1, 61), which is free from points of A;. Likewise A, 
can not be everywhere dense in (ai, b,), so there must be some por- 
tion of this interval, say (a2, b2), which is free from the points of A». 
Continuing in this manner we get a sequence of intervals 
(ao, bo), (a, bi), (as, be), Kite ee ey (Qn; bn); BS Pec: 

each of which is contained in the previous intervals. This sequence 
defines either a definite point 2 according to the theorem of Art. 7 
or an interval whose length is different from zero. There is then at 
least one point in (ao, bo) which is not a point of EZ and hence belongs 
to C(#). As (do, bo) is any subinterval of the given interval, it fol- 
lows that points of C(£) are to be found in every subinterval how- 
ever small of (a, b); that is, C(Z) is everywhere dense in (a, b), as the 
theorem states. 

As an immediate consequence of this theorem, we have the follow- 
ing corollary. 

Cor. The continuum is a set of the second category. 

The complementary set to the continuum contains no points and 
hence cannot be a set which is everywhere dense. Therefore, by the 
foregoing theorem the continuum cannot be of the first category; for, 
if it were of the first category, its complementary set would be every- 
where dense. Since it can not be of the first category, it must be of 
the second category. 

TueoreM IV. The complementary set of one of the first category 
ts of the second category. 

From Theorem III, the complementary set is in every portion of 
the given interval everywhere dense. Denote the given set by 

t= ATO AG ee Acts 

Assume the complementary set to be also of the first category, and 
denote it by 

OCB) = Pet Pats 2+ Pato +, 
where P,, (n = 1, 2,3, - - - ) isin no portion of the given interval 
everywhere dense. The sum 
E+C(E) = (Ai+ Pi) + (Az+ Po) +> > > +(Ant+Pa) +t: 
is likewise a set such that each term (A, + Pn) is in no subinterval 
everywhere dense. This sum must then be a set of the first category, 
but this is impossible since it is identical with the continuum. 
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If the given set is of the second category, it does not follow that 
the complementary set is of the first category; for, there are sets 
of the second category whose complementary sets are also of the 
second category.! 


TuroremM V. Every set of the second category, which is comple- 
mentary to one of the first category, has the cardinal number of the 
continuum. 


As we have seen, a set E of the first category may or may not be 
everywhere dense in the interval containing it. Without loss of 
generality, we may assume this interval to be (0, 1). The comple- 
mentary set C (E£) is everywhere dense in the given interval (0, 1) 
by Theorem III. We shall undertake to show that there is a one-to- 
one correspondence between the points C(#) and those of the con- 
tinuum (0, 1). 

Let ¢ be any point in the open interval (0, 1). Then the number 

can be written in the dyadic system of numbers as follows 


& = O.ny0et3s * «+ + Un * +, 


where the digits x, are either 0 or1. The given set # can be expressed 
as the limit of the sequence {£#,}, where none of the sets EF, are 
everywhere dense in any portion of (0, 1) although EF itself may be 
everywhere dense in that interval. Let 6 be any subinterval of (0, 1) 
containing no points of #; that is, it contains only points of C()). 
Within 6 may be found two subintervals 60, 6; such that each con- 
tains only points of C(£,). Within each of these intervals can be 
found two subintervals, denoted respectively by 600, 60: and 610, 6u, 
such that each contains only points of C(#3). Continuing this process 
indefinitely we obtain various sequences of intervals of the type 


b:,, Oz) ° ed Ox; * 2 


where N = 2003+ - - 2, and each digit 2, is either zero or one. 
Each of these intervals lies within the preceding, and they may be so 
chosen that the length of 6, approaches zero as n becomes infinite. 
Hence, {dy} determines in the limit a single point of C(Z). Each 
point ¢ corresponds to a definite sequence of intervals {6y}, namely 
that one where LN is the sequence of digits defining t. Conversely, 


n—- co 
1 See Lebesgue, Journal de Math., Vol. 70 (1905), p. 186. 
? A set of the second category which is complementary to one of the first cate- 
gory is sometimes called a residual set. See Denjoy, Journal de Math. (1915), 
Vol. 80, p. 123. 
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every point of C(Z) can be made the limit of a sequence of intervals 
of the type {6x}, and to each such sequence there corresponds a 
definite point of (0, 1). Moreover, the correspondence is unique, if 
we exclude those sequences in which the digits x, are from some point 
on all 1’s; for, otherwise two sequences {4x} might correspond to the 
same value of ¢, since 

0. See yt eee OB Bear ; 

0. qe) x,1000 Skee 


represent the same value of ¢. Hence, to each point ¢ there corre- 
sponds one and only one point of C(£), and conversely to each point 
of C(E) there is one and only one point ¢ of the interval (0, 1), and 
the theorem follows. 


THEOREM VI. Given a finite or enumerably infinite number of sets 
of the first category. The product of their complementary sets is the com- 
plement of a set of the first category. 


Denote the given sets by 


fi =An+Arwt: +> +Ant:s-:, 
Ey=An+Ao2t+: +: +:+Am+:--, (3) 
En=Am+Am + ih tales + Amn + ye er 


where each A,,, is in no subinterval of the given interval (a, b) every- 
where dense. The product of the complements is composed of those 
points which do not enter into any £,,; that is, we have 
[C(Bi)-C(H:)--- -Ciy)- ---] 

=C(Ei+ E2++--++#H,+-- >). 
Consider the sequence of sets {B,}, formed by taking the elements of 
(3) in the order of their occurrence in successive diagonals; that is, 

By = Aun, Be == An, B; : An, Bs = Agi, Bs os Az, ve me 
Each of these sets is in no subinterval of (a, b) everywhere dense, 
and hence their sum, namely 
Soe Be Dee gies 

is of the first category. The complementary set C(£) is by The- 
orem IV of the second category. It is, moreover, the complementary 
set of one of the first category, a statement that cannot always be 
made of a set of the second category. 
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19. Non-linear sets. Thus far we have considered only linear 
sets. Many of the properties developed may be at once extended to 
the case where the points are distributed over the plane or through 
space. We shall now consider some of these extensions particularly 
to two-dimensional sets. The definition of such fundamental terms 
as limiting point, point of condensation, everywhere dense, etc., 
may be extended at once to non-linear sets. For interval we sub- 
stitute region and speak of a two-dimensional set as bounded if it is 
bounded in each dimension; that is, if all the points lie within a defi- 
nite rectangle. Just as in the case of linear sets, every bounded two- 
dimensional infinite set has at least one limiting point. Moreover, 
every sequence of rectangles, such that each lies within the preceding 
and the limit of the areas is zero, defines in the limit a segment of 
a straight line or a definite point according as one or both of the 
dimensions approach zero. By the distance between two points 
whose codrdinates are (x, yi), (2, ye) is understood the positive 
value of (re — 21)? + (ye — yi)?» By the distance between two sets 
is meant the greatest lower bound of the distances between the points 
of one set and those of the other. For many purposes it is convenient 
to make use of what Jordan calls ! the écart, namely 

[vz —m|+|y—yl, 
instead of the distance. 


One of the important relations between linear and non-linear sets 
is given in the following theorem. 


TuHeEoreM I. There exists a one-to-one correspondence between the 
totality of points of a plane and those of the linear continuum. 


This theorem is equivalent to saying that the two-dimensional 
continuum has the same cardinal number as the linear continuum. 
As already pointed out, the points on an indefinite straight line may 
be placed in a one-to-one correspondence with the points of seg- 
ment (0, 1). This can be done on both axes of codrdinates, and 
consequently we can establish the theorem by showing a one-to-one 
correspondence between the points of the interval 0 < x S 1 and the 
unit square, where 0 < % S$ 1,0 < y $1, as indicated in Fig. 7. 

Let P(x, y) be any point in this square. The codrdinates z, y are 
real numbers and can be represented in a number system having the 
base 2. We may then write 


1 See Cours d’ Analyse, Vol. I, p. 23; also Fréchet, Rend. Palermo, Vol. 22, p. 53. 
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Ma ONE Ra) OS eye 

Y. =OGiYe <r ge dss ey 
where x;, yx are either 0 or 1. In order to avoid ambiguity, we shall 
assume that the digits defining x, y contain the digit 1 an infinite 
number of times. With this sg 
understanding, the codrdinates 
of P(x, y) can be expressed in +1 
one and only one way as a 
dyadic fraction. Divide the 
digits composing these two 
decimal fractions into groups 
so that’each group ends with 
the digit 1. Thus, if x and y 


have the particular values Fia. 7. 
SS OPO ot ru T= ; 
a= OU 109 1 0'O EO OMS 


the arrangement by groups is 

=z = 0.(1) (001) (01) G) (0001)... -, 

y = 0.(01) (01) (1) (001) (001) ---. 
From this group arrangement, we form a new decimal number ¢ by 
taking a group of digits first from one of the numbers 2, y and then 
from the other. Thus, in the particular case just given we have 

t = 0.101001010111001---. 

The number ¢ thus defined is represented by a definite point of the 
segment (0, 1), and thus to any point P of the square there cor- 
responds one and only one point ¢ of the required segment. 

Conversely, given any point ¢ of the segment (0, 1) represents 
uniquely a dyadic number, with the foregoing restriction as to 
the digit 1 contained in it. We can show by reversing the foregoing 
process that there corresponds one and only one point P of the given 
unit square. Since the required correspondence exists, the theorem 
follows. 

The Heine-Borel theorem may be stated for two dimensional space 
as follows. 

TueoreM II. Let R be a closed rectangular region and let E be a 
set of rectangular regions such that any point of R is an inner point 
of some one of the regions in E. Then we may select from E a finite 
number of regions such that any point of R is also an inner point of 
one of them. 
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The proof of this theorem is similar to that given for the cor- 
responding theorem for linear sets. 

20. Content of point sets. Among the most important properties 
of point sets are those which concern the notions of content and of 
measure. These notions are of fundamental value in many of the 
modern discussions in analysis, particularly in questions concerning 
differentiation and integration. In fact Hankel! first discussed the 
question of content in connection with the problem of integration. 
Cantor? later developed the general theory. The theory thus de- 
veloped, however, had certain defects when applied to non-closed 
sets. Peano? and Jordan‘ have undertaken to remedy these defects 
by introducing what they have called inner and outer content. The 
notion of content as originally defined by Hankel and Cantor is now 
of interest mostly for its historical importance. It has been largely 
replaced by the notion of measure to be defined later. In the dis- 
cussions to follow, we shall, however, use the term content to mean 
what is sometimes called the Jordan measure or extent of a point set.® 
Stated for linear sets this definition may be formulated as follows: 

Let us suppose that the given set # lies in a definite interval 
(a,b). Divide (a, 6) into a finite number of subintervals whose 


lengths may be denoted by 61, 62, - - -, 6%, ° -* *, On, where n has 
any positive integral value. Denote by 6 the norm of the 6,’s; 
that is, the maximum of the values 6), 62, - - - , On. Some of these 


intervals may contain only inner points of EH, while others may con- 
tain no such points, and still others may contain points of the set and 
points exterior to the set. All intervals containing boundary points 
belong to this last class. We are interested in the first and last of 
these classes of intervals. Denote by 2, the sum of the lengths of 
those intervals 6; which contain only inner points of H, and by D2 
the sum of the lengths of those intervals which contain both points 
of EH and of the complementary set. 

Suppose the number of intervals into which (a, b) is divided be 
increased indefinitely in such a manner that the norm 6 approaches 
zero. It may be shown® that 2, 22 approach definite limits which 

1 Math. Ann. (1882), Vol 20, p. 87. 

2 Math. Ann. (1884), Vol. 23, p. 453. 

3 Applicazioni geometriche del calcolo infinitesimale (1887), p. 153. 

4 Journal de Math. (4) Vol. 4, p. 77 (1892); Cours d’ Analyse, Vol. 1, pp. 28, 29. 

5 Jordan used the term eténdue, and German writers commonly use the term 
Inhalt as the equivalent. 

6 See Jordan, Cours d’analyse, Vol. I, pp. 28-31. 
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are independent of the manner in which the given interval is sub- 
divided into the 6, intervals. We shall denote these limits by 21’ 
and 2»’, respectively. The limit 2,’ is called the inner content of Z. 
On the other hand, 2.’ + D.’ is called the outer content of E. 

If the inner content and outer content are the same, that is if 
2’ is zero, then E is said to be measurable in the Jordan sense and 
we shall speak of this common value as the content or Jordan measure 
of the given set. 

It follows from this definition that every set which does not have 
a portion which is identical with the continuum must have the inner 
content zero. Such a set is measurable in the foregoing sense only 
if the outer content is also zero. Hankel and Cantor used the term 
content as identical with outer content as just defined. 

The following is a simple illustration of a measurable set. Given 

oe eee ee a) 
There is but one limiting point, namely 0, which is not a point of 
the set, and hence is a boundary point. The inner content is zero. 
The outer content is also zero; for, if we inclose the point zero in an 
arbitrarily small interval, there remains only a finite number of points 
of # exterior to it, each of which can be included in an arbitrarily 
small interval. Hence, all the points of E can be included in a finite 
number of intervals the sum of whose lengths is arbitrarily small. 
As the inner content and the outer content are both zero, it follows 
that the given point set is measurable having the content zero. 

The rational numbers in the interval (0, 1) form a non-measurable 
set in the Jordan sense; that is, this set does not have a definite 
content. The inner content is zero, since there are no subintervals 
however small that contain only inner points of the set. On the 
other hand, the outer content is one, since the set is everywhere 
dense. 

‘The definition of content can be extended to space of any number 
of dimensions. For example, let H be a set of points in two-dimen- 
sional space. Suppose the plane to be covered by a grating formed 
by drawing lines parallel to the axes of codrdinates as shown in 
Fig. 8. Denote by a the length of one side of these squares. Some 
squares may contain only inner points of #. Other squares may con- 
tain boundary points of H. Denote by 2; the sum of those squares 
which contain only inner points of EZ, and by 22 the sum of those 
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squares which contain points of Z and points of C(#). Let the num- 
ber of squares increase indefinitely by making the length a of one 
side approach the limit zero. As in the case of linear sets, 21 and Ze 
approach definite limits as a 
approaches zero. Denote these 
limits by 21’, 22’, respectively. 
The outer content is 21’ + 2’, 
while 2,’ is the inner content. 
If the two limits are equal, that 
is if Zo’ is 0, then the given 
set is said to be measurable 
in the Jordan sense. 

If a point set has the content 
zero, it is sometimes called a 
discrete set. The set given 
in (1) is an illustration. It - 
will be seen that a set can not be discrete unless its outer content is 
zero. Moreover, the inner content must also be zero and this can 
never be the case if in any portion of the given interval the points 
of the set form a continuum. 

Among the theorems involving content, we have the following: 


Fig. 8. 


TurorEeM I. The content of a set E, which is measurable in the 
Jordan sense, 1s equal to the content of its derived set E’. 


First of all we shall show that the outer contents of EH and E’ 
are the same. Since by hypothesis EH’ has a definite content, we can 
inclose the points of H’ in a finite number of intervals the sum of 
whose lengths is arbitrarily small, and the number of points of E, 
exterior to those intervals is finite; for, otherwise there must be at 
least one limiting point of H and hence a point of E’ which has not 
been included. Inclose each of these n isolated points in an interval 
of arbitrarily small length e. The outer content of E is then equal to 
the outer content of EH’ plus n-e. But n is finite and € is arbitrarily 
small, and consequently the sum of the lengths of the intervals in- 
closing the points of # which are not points of H’ is arbitrarily small; 
that is, the outer contents of the two sets differ by less than any arbi- 
trarily small amount by the proper choice of € and hence are equal. 

We shall show that the inner contents of the two sets are also 
equal. By hypothesis E is measurable in the Jordan sense, and hence 
its outer and inner contents are the same. The inner content of E’ 
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tan not be less than that of EZ, for E’ must contain all subsets of E 
which consist of only inner points and therefore form by themselves 
a continuum. In other words, if there is any subinterval such that 
all of its points are points of H, then that subinterval appears in the 
sum of the intervals inclosing points of HZ’. Moreover, the inner 
content of E’ can not exceed the outer content of E’. But, as we 
have seen, the outer contents of E and £’ are the same, and this 
common value must be equal to the inner content of EH. Conse- 
quently, the inner content of ZH’ is less than or at most equal to that 
of H. It follows from the fact that the inner content of EZ’ can not 
exceed that of H and can not be less than it, that the inner contents 
of H’ and E must be equal. 

Since the outer and the inner contents of H are respectively equal 
to those of EH’, it follows that the content of # and EH’ are the same, 
as the theorem states. 

The first part of the foregoing demonstration shows that every 
open set has the same outer content as that closed set of which it is 
a part; for, the closed set is none other than the first derived set 
plus at most a set whose outer content is zero. In the discussions to 
follow, particularly in the consideration of the Riemann integrals, 
we shall have occasion to consider the properties of discrete sets, 
that is sets whose content is zero. It follows also that if the first 
derived set is discrete, then the given set is discrete. 


THEOREM II. Every bounded point set of the first species is discrete. 


The given set # can have but a finite number of derived sets. 
Let E™ be the last derived set. Then #™ contains only a finite 
number of points; for, otherwise it would have at least one limiting 
point and #@*» would be different from zero, which is contrary to the 
assumption that ZH“) is the last derived set. Inclose each of the points 
of EZ) in an arbitrarily small interval of length €;. If there are n, such 
points, then the sum of the lengths of the intervals inclosing these 
points is 7€;. Each of these intervals incloses an infinite number of 
points of the derived set of next lower order and hence of the original 
set. Exterior to these 7; intervals there are only a finite number of 
points belonging to H*-). Denote by nz the number of such points. 
As before inclose these points in an arbitrarily small interval of 
length €2. Their sum is therefore n2€2. Exterior to the m+: inter- 
vals thus far considered there are but a finite number of points, say 
ns, of the derived set H*~). Inclose these in intervals of length ¢; and 
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proceed as before. Continuing this process, after k + 1 operations 
we have all of the points of the given set inclosed in intervals of arbi- 
trarily small length. We may now put 


€ = M6 + Meee + - > + Mier te ° ° + Mey 1Ex1, 


where each term is arbitrarily small upon the proper choice of €:. 
Consequently, € is also arbitrarily small, and we have all the points 
of E inclosed in a finite number of intervals the sum of whose lengths 
is arbitrarily small. It follows that the outer content of E is zero. 

The inner content of E is also zero; for, the inner content is never 
negative and can not exceed the outer content. As both the inner 
and the outer content of £ is zero, it follows that its content is zero 
and the set is discrete. 

There are point sets of the second species which are not discrete. 
The continuum is a simple illustration. On the other hand, there are 
sets of the second species which are discrete. For example, it is 
possible to have a perfect set of content zero. The following is an 
illustration. 

Let the required set H be defined as in Art. 17 by means of a set of intervals 


{6,} which is enumerable and everywhere dense in the interval (0,1). The length 
of 6, is (4)" and we exclude the middle third of each interval by the previous sub- 


(@) do 5y Oe 1 
at 
Fig. 9. 


division, as indicated in Fig. 9. We regard the 6 intervals as open intervals; 
that is, we regard the end-points as points of the remaining intervals. The set 
E is defined as the set of end-points of the 6 intervals increased by their limiting 
points. The outer content of H is the limit of the sum of the remaining free in- 
tervals. This outer content is zero, provided we can show that the limit of the 
sum of the 6 intervals is equal to the length of the original interval, namely 1. 
This sum is the limit of the series. 


3+2(G) 4G) + 28 GY tee 
QQ eG] 
AG) (GeO) 
eee Re 


Since the limit of the sum of the 6 intervals is 1, the limit of the sum of the remain- 
ing intervals, that is the outer content of E, is 0. 


Arr. 20] CONTENT OF POINT SETS 63 


The inner content of Z is also 0, as it cannot exceed the outer content. The 
content of EF is then zero, since both the outer and the inner content is zero. 
But, as we have already seen, the set E is a perfect set and consequently is of 
the second species. 

Among the additional properties of discrete sets we have the 
following. 


THEOREM III. Any bounded closed set is discrete, provided it is 
enumerable. 


Since the given closed set is enumerable, it can be inclosed in an 
enumerably infinite set of intervals such that each point is an inner 
point and the length of each interval is arbitrarily small. For ex- 
ample, let each point E, of the given set {H,} be inclosed in an in- 


terval whose length is = where € is arbitrarily small. The sum of 


these intervals, namely 

i eee ee 1 i “ee 1 a a 
2+ 3 2 ei | Ad ae eee =o 
is then also arbitrarily small. By the Heine-Borel theorem, it follows 
that a finite number of these intervals can be selected such that all 
of the points of the given set are inner points of these intervals. As 


each interval is of length = the sum of a finite number of them is 


arbitrarily small, and hence the outer content of the given set is zero. 
The inner content is also zero, since it can not exceed the outer con- 
tent, and the theorem follows. 

It is of interest to note that in case the given set is non-enumerable, 
its content may be zero or anything between zero and any value 
which is less than the length of the interval containing the set.? 


TueorEM IV. A discrete set can not be everywhere dense in any 
subinterval. 


By Theorem I the content must be the same as that of the derived 
set. If the given set is everywhere dense, then the first derived set 
is a portion of the continuum itself and of course has a content dif- 
ferent from zero. 

The converse of this theorem is not true; for, there exist point 
sets which are in no subinterval everywhere dense and still are not 
discrete. 


1See Harnack, Math. Ann., Vol. 19, p. 239. The example given by Osgood, 
Amer. Math. Jour., Vol. 19, p. 167, is also an illustration. 
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TuroreM V. Let Ey, E2,- - + be a sequence of bounded, discrete 
sets having the property that each is contained in the one that follows, 
and let E be the limiting set of the sequence. Then any closed subset 
of E is discrete.} 


The set E is characterized by the properties that every point of 
E is a point of some set EZ, of the sequence, and conversely every 
point of any set EZ, in the sequence is also a point of H. Since each 
E,, is discrete, its points can be enclosed in a finite number of inter- 


vals the sum of whose lengths is less than ee where € is an arbi- 
trarily small number. 

It follows that all the points of the sequence {H,}, and conse- 
quently those of any subset of H, can be made the inner points of a 
set of intervals, the sum of whose lengths is less than 


2” 2) oar ae 
As each E, is bounded, the set H, and hence any subset of £, is 
bounded. It follows from the Heine-Borel theorem that any closed 
subset of # can be inclosed in a finite number of the above intervals 
and hence has the outer content zero. As the inner content must 
also be zero, it follows that the subset is discrete, as the theorem 
states. 

21. Measure of point sets. The notion of content, as defined in 
the previous article, has certain disadvantages when applied to point 
sets in general. In fact, there exists a large class of non-measurable 
sets, if we base the classification on the definition of content. As a 
basis for a more general theory, Borel ? and Lebesgue ? have intro- 
duced what they call the measure of a point set. It differs essentially 
from the definition of content in that the points of the given set are 
inclosed in a finite or an enumerably infinite number of non-over- 
lapping open intervals, the sum of whose lengths is finite, instead of 
being inclosed in a finite number of intervals. Of the two definitions 
of measure, that of Lebesgue will be made use of in the discussions 
to follow unless otherwise stated. 

The given set EH is assumed to be contained in a finite interval 
(a, 6). The intervals used to inclose the points of E may be selected 


Bene {jtat: 5 ey the. ~ } 2 es 


1 See W. H. Young, Quarterly Journal, Vol. 35, (1904), p. 189. 

2 See Legons sur la théorie des fonctions (1898), p. 46. 

* See Ann. di Math. (1902), series III, Vol. 7, p. 231; also Legons sur Vintégra- 
tion, p. 102. 
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in an infinite number of ways. By each choice the sum of the lengths 
of the intervals is a definite number. The aggregate of all these 
numbers has a greatest lower bound, which is called the exterior 
measure of £, and is denoted by m.(£). It is always possible, there- 
fore, to select an enumerable set of intervals {6,} inclosing the 
points of # so that 

2 On < m.(£) + €, (1) 


where € is arbitrarily small. 

If we denote the length of the interval (a, 6) by 1, we define the 
interior measure of £ as 

L—m{C(E)], 

and denote it by m.(#). If the interior measure and the exterior 
measure are the same, we say that the set is measurable, and we call 
this common value the measure of the given set. It is clear that if a 
given bounded set is measurable, then the complementary set C(£) 
is also measurable. 

We shall understand the measure of an interval to mean its length, 
and consequently if any set of points G is composed of a set of intervals 


{ 6}, we may write GE ane: 


In the interval (a, b), let us now consider an enumerably infinite 
number of point sets.Gi, Go, - + -,Gn,-- +, each of which is com- 
posed of a finite or enumerably infinite number of sets of non-over- 
lapping intervals. Any two intervals may have a common end-point, 
which belongs to one or the other of the intervals but not to both. 
The aggregate of intervals composing. the sum of the point sets G, 
is also enumerable, since it consists of an enumerably infinite number 
of enumerable sets of intervals. The intervals of this aggregate will 
overlap only if two or more of the sets G, have points in common. 
In case no two of the sets G, have points in common, we have 


mG: +Go+-+:+Git---+)=mG)+m@)+---: 
+mG,)+:-+. (2) 


If, however, two or more of the sets G, do have points in common, we 
have 


mG,+Gz+---+Gat-°+-)smG)+mG@)+--° 


If two sets, say Gi, G2, have points in common, we have also 


mG, + G2) = m(Gi) + m(G2) - m(G1:G:). (4) 
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This relation can, of course, be extended to the sum of any finite 
number of the sets Gn. 

As we shall now see, the foregoing properties of the sets G, can 
be employed in studying the measure of open sets and also closed sets 
of points. By Theorem II, Art. 16, an open set of points can be ex- 
pressed as the sum of a finite or enumerably infinite number of open 
intervals. The results given in (2), (3), and (4) then apply to all 
open sets of points. Consequently, if we have a finite or enumerably 
infinite number of open point sets An, no two of which have points in 
common, we have from (2) 


m(Ai+ As+++++An++-+) = m(Ai) + m(Ad) +--- 

+ mag + Aue 
If two or more of the sets A, do have points in common, then from 
(3) we have 
mA, + Ass + Ag + >) (As) mag ee 

Fim Asyb Ae 
Any two open sets A;, Az having points in common satisfy the rela- 
tion given in (4), and hence we have 


m(A, ate Ae) = m(A,) aie m(Ao) = m(A,: Age). (7) 


In case Ai, Ae have no points in common, then m(A,- A2) is zero. 
From these properties of open sets, we are able to deduce the 
corresponding properties for closed sets; for, the measure of a closed 
set H is the length of the interval (a, b) containing it diminished by 
the measure of the complementary set C(£), that is 
m(E) = (b — a) — m(C(E)], (8) 
where C(£) is necessarily an open set since it is the complement of 
the closed set H. 
If we have given two closed sets Z; and FE, whose complementary 
sets are respectively the open sets A; and A», we have 
C(E,: He) = Ay + As, 
C( HE, + Ee) = Ay: As. 
From (8) we obtain 
mLC (Ey: E2)] = m(A; + Ae) = (6 — a) — m(E;- B.), 
mLC(E;)] = m(A)) = (6 — a) — m(F)), 
mLC(E2)] = m(A2) =b —a— m(E.), 
mLC(E, + E2)] = m(Ai: Az) = (6 — a) - m( EH; + Ee). 


Art. 21] MEASURE OF POINT SETS 67 


Substituting these values in (7), we get 
m(E; + Es) = m(E,) + m(E2) — m( Ey: E2). (9) 
If the given sets Z,, E: have no points in common, then m( Ey: Es) 
vanishes and we have 
m(E£, + E2) = m(E}) = m( Ee). (10) 


The exterior measure is always equal to or greater than the in- 
terior measure. For, let the given set EZ be inclosed in the intervals 
{6}, while those of the complementary set are inclosed in a set of 
intervals {y}. It follows from the corollary to the Heine-Borel 


theorem that 
2{o} +2{y} 2b-a. 
Expressed in terms of measure, we have 
m(H) +m. LC(E)] 2 m(a, b), 

or me(H#) = m(a, 6) — m{_C(E)] = m.(E). 

If the exterior measure is zero, then it follows that the interior 
measure is also zero and the set is measurable, having the measure 
zero. The exterior measure has certain other properties which we 


shall have occasion to use. For example, if we have given two sets 
E,, E2, where EL; > E2, we have at once the relation 


m-(E;) = mE). (11) 

If we have given a finite or enumerably infinite number of sets of 

points H;, H.,- - -,H,,- : + contained in an interval (a, b), then 
mE; + E, jee 6 ae E,, a es -) = m( Ei) = me( Ee) 

rat Per arene Bia) oboe s oes 2) 


For, each set #, can be inclosed in a finite or enumerably infinite set 
of open intervals 
diy Onny Ong, hy Oaks” 

Consequently, all of the points of the sequence { #,} can be inclosed 
in an enumerably infinite number of enumerably infinite sets of 
open intervals which, we know, is an enumerable set of open intervals. 
We shall denote this set of intervals by {6,}. Since mZ6, is the length 
of the sum of these intervals, we have 


mA(H, + EHe+: ‘ -+#H,+: : ‘)Sma+ 4+: Q 
+ Ont: + +), 
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As the sum of the lengths of the intervals 6, is at least equal to the 
length of their sum, this inequality can be written 


m(Ei+ Hot: > +> +En+-> + +) S m(d:) + m2) +- 

7 On) ch = ieee 
The greatest lower bound of the sum of the lengths, that is the 
measures of the intervals 6,, is the sum of the exterior measures of 
the sets E,. Hence, the intervals 6, may be so chosen that 


m(6) + m(d2) +--+ > +m(On) +: °° =€+ mH) + m.(E2) 
fos -+m(En) +° one 


however small the positive number € may be. Hence, from the above 
inequality, we have 


m(fi+ Fot+-:-+Ha+-:-+-) S€+m(Ei) + m(Ee) 
+---+m(En)+-°°:. 


Since this relation holds for every arbitrarily small positive value of 
€, we have in the limit the required relation given in (12). 

As already mentioned, the definition of measure enables us to in- 
clude among the measurable sets a much larger number than does the 
definition of content. For example, we saw that the set of rational 
numbers in the interval (0, 1) was not measurable in the Jordan 
sense. It is, however, measurable in the Borel-Lebesgue sense; for, 
it is an enumerable set and all such sets are measurable, as we shall 
now show. 

Suppose the given set H lies in the interval (0,1). When arranged 
in an ordered one-to-one correspondence with the positive integers, 
we can inclose the first point of the set in an open interval of arbi- 
trarily small length e. ss second point can then be ae in an 


open interval of length 5 the third in one 2 length 5 a and in gen- 
mae ete. Thus, all of the 


points of # can be inclosed in a set of a ee ie open inter- 
vals whose sum does not exceed 


eral the n‘ in an open Spe of length 


8 ( (S 
65 Egg hes he 
it Oa 1 
SOC att tag i + sea ear hee 


As € is arbitrarily small, it follows that 2¢ is also, and hence the given 
set can be inclosed in an enumerably infinite set of open intervals the 
sum of whose lengths has the lower limit zero; that is, the exterior 
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measure of E is zero. As the interior measure is never negative and 
never greater than the exterior measure, it must also be zero. It fol- 
lows that # is measurable and has the measure zero. 

From the foregoing conclusion concerning enumerable sets, it 
follows, as already pointed out, that the rational numbers in any 
closed interval form a measurable set. The set of irrational numbers 
in a given interval is also measurable, since they form the comple- 
mentary set of one which is measurable. 

The above illustration shows that of the definitions of content and 
measure that measure is the broader. Any point set that has a defi- 
nite content has also a definite measure and the two are equal. The 
converse, however, is not true. If the given set is bounded and closed, 
it follows that the outer content and the measure are always the 
same !; for, by the Heine-Borel theorem (Theorem IV, Art. 16) the 
points can then be inclosed in a finite number of non-overlapping 
open intervals, the greatest lower bound of the sum of whose lengths 
is the outer content of the set. 

As in the case of content, the definition of measure can be ex- 
tended to point sets of two or more dimensions. The exterior measure 
is the greatest lower bound of the sum of the open regions containing 
the given set, while the interior measure is defined by means of the 
exterior measure of the complementary set. 

The exterior measure of a set of points H may be regarded as the 
greatest lower bound of the measure of the open sets containing £, 
while the interior measure is the least upper bound of the measure 
of the closed sets contained in EL. For, as we have seen, every open 
set can be expressed as the sum of a finite or enumerably infinite 
number of open intervals. The sum of the lengths of these open 
intervals is the measure of the set of points defined by them. Hence, 
from the definition of exterior measure, it follows that the exterior 
measure of # is the greatest lower bound of the measure of the open 
sets containing HZ. Likewise, the exterior measure m{_C(E) ] is the 
greatest lower bound of the measure of the open sets containing 
C(£). The interior measure m;(Z), that is 1 — m{C(£)], is then the 
least upper bound of the measure of the complementary sets of points, 
namely the closed sets contained in HE. This discussion establishes 
the following theorem. 

1 As already stated, the outer content in the Jordan sense is identical with 


the term content as used by Cantor. For closed sets the term measure is iden- 
tical with the term content of Cantor. 
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TuroremM I. A necessary and sufficient condition that a given set 
E is measurable is that there exists an open set E; containing E and a 
closed set Ez contained in E such that 

E,; > E > E,, m(E;) — m(E2) < €, 
where Ey may be a null-set and € is an arbitrarily small positive number. 
TueoreEM II. Every bounded, open set of points 1s measurable. 


As we have seen, every bounded, open set is the sum of a finite 
or enumerably infinite set of non-overlapping, open intervals {6,}. 
The sum of the lengths of these intervals is the measure of the given 
set E. However, each of these open intervals can be expressed as the 
sum of an enumerably infinite number of closed intervals having at 
most end-points in common. Hence, the sum of the open intervals 
{5,} can be expressed as the sum of an enumerably infinite number of 
closed intervals. The sum of the lengths of these closed intervals is 
equal to the sum of the intervals {6,}. It follows that the open set 
E is contained in an open set FE, and contains a closed set H2 such that 
the measures of the two sets may be made to differ by less than an 
arbitrarily small positive number ¢. Consequently, the given set is 
measurable. 


THEOREM III. Every bounded, closed set is measurable. 


The given set is complementary to a bounded, open set, which is 
measurable by Theorem II. Since the complementary set is meas- 
urable, the given set is also. 

We may also state a necessary and sufficient condition for measur- 
ability as follows: ! 


THEOREM IV. A necessary and sufficient condition that a point set E 
lying in an interval (a, b) has a definite measure is that 
E = FE, + fh, 
where E, ts a closed set and E; 1s a point set having an exterior measure 
less than an arbitrarily small positive number e. 


This condition is necessary. As we have seen, the exterior measure 
of Z is the greatest lower bound of the measure of the open sets con- 
taining H, while the interior measure is the least upper bound of the 
measure of the closed sets contained in #. There exists then an 
open set A and a closed set H2 such that 


A> E> E,, where m(A) — m(E2) < €. 
1 See de la Vallée Poussin’s Intégrales de Lebesgue, p. 23. 
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From the definition of a complementary set, we have 
C(A — E2) = C(A) + Fe. 


Each of these sets is closed and consequently measurable. We then 
have from (9) 


mLC(A — E2)] = m[C(A)] — m(F). 


Subtracting each member of this equation from 1, the length of the 
interval (a, b), we have 


l—mLC(A — E.)] = 1 -— m[C(A)] - m(F,). 
whence m(A — E2) = m(A) — m(f2). 
If we now put EF = EF, + H, where EF; < A — F,, 
we have me(E;) S m(A — E,) = m(A) — m(k) <«, 


and we have the condition stated in the theorem. 
The given condition is also sufficient. The given set can be written 


E =, + £,, 

where £, is a closed subset of H. We have from equation (12) 
m(E) = m(E;) + m-(E2). (13) 
The set ZH; is closed and consequently is measurable. We then have, 
m(E2) = m(E2). (14) 
By hypothesis, we have mH) <€. (15) 

From (13) we have, by aid of (14) and (15), 

m(E) < m(E2) + €. (16) 


Remembering that m;(F) is the least upper bound of the measures 
of the closed sets EH; contained in HL, we have from (15) 


m(E) = mE) +6, 

or m(E) — m(E£) <e. 
As the choice of € is arbitrary, this relation must hold for every 
value of € however small. It follows that / satisfies the definition 
of measurability. This conclusion completes the proof. The theorem 


is equivalent to saying that the measure of F is the limit of the 
measure of the closed sets contained in £. 
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Turorrem V. Given a finite or enumerably infinite number of 
measurable point sets 
Eh ee 
contained in a finite interval (a, b); then the sum and the product of 
the sets are also measurable. 
We shall first consider the product. From Theorem IV we have 
for an arbitrarily small positive number e 


Fi, = Ey + Ey, where mein <3 7 
E, = Hy + Ex, where m-Hx < ? 
(17) 
E, = En + Eno, where meEn < om 
where Ez, Eo, + + +» Enz, + * + are closed sets. Forming the product, 
we have 
(Ei-Ea- + + > +Hye + + +) = (Bu + Eye) (Hn + He) + + > 
(Ent + E,2) fe ores (18) 


Each point in the product which is not common to all the sets Enz 
must be contained in at least one of the sets H,. Since 


mMe( Ens) < = 


for all values of n, it follows that (18) can be written in the form 


(ByiBy 6 + +B oe.) = Bp He el 
where the product (Hi2: Ny: +--+ +E: ++ + )isaclosed set and 
A is a point set having an exterior measure which is less than e; for, 
we have 

A<Exyt+HEnt+-:-++#ut--: 
and hence 
mef(A) < mH) + me(Hu) ++ ++ +m(Em) ++: > 
€ € € 
Sis Oa tie : a 7) =€, 


This result is, by Theorem IV, the condition that the product is 
measurable. 


1 See de la Vallée Poussin’s Intégrales de Lebesgue, pp. 24-25. 
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We shall now consider the sum 
H=E,+h&+-+-+-+H,+- 
The complementary set C(Z) contains those points found in none of 
the sets H,; that is, it is the product of the complementary sets 
C(E,,). We may then write 
C(E) = C(B:) - C(E:)- +» + -C(B,)- 

Being a product, C(Z£) is measurable by the foregoing discussion, 
and hence £, being the complement of C(£) is also measurable. 


THEOREM VI. Given a finite or enumerably infinite set of measur- 
able point sets contained in an interval (a, b), no two sets having points 
im common; then 
mEHi+E,t+- + -+#H,+:--)=m(E)+m(h)+--- 

+m E,) + - 

We shall first consider the sum of two sets EH; and E2. By aid of 

Theorem IV, we may write 


FE, = A, + By, BE, = Ag+ Bz, 


where A,, A» are closed sets and the exterior measures of B,, Bz are 
arbitrarily small. Hence, we have 


E, + E, = (Ai + As) + (Bi + Be). 


The sets A;, A» are closed and have no points in common; hence, 
we have from (9) 

m(A; + Ao) = m(A1) + m(A2). 
The measures of FE), FE: are respectively the least upper bounds of the 
measures of the closed sets Ai, Az contained in them. As these meas- 
ures approach their least upper bounds, the exterior measure of 
(B, + B2) becomes less than any arbitrarily small positive number e. 
In the limit we have 

m(E, + Ex) = m(Ei) + m(f»). (19) 


It is at once evident that this result can be extended to the measure 
of the sum of any finite number of sets. 

We shall now consider the sum of an enumerably infinite number 
of point sets. Since this sum is measurable, the measure is equal to 
the exterior measure and hence from (12), we have 


mE, + H2+- +> +#a++ + +) Sm) + m(E) + - 
+m(En) ++ ++. (20) 
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On the other hand, we may write 


mE, +Eet+> > >that: > -)=mh+ he +- - > +H,) 
+m(R,) = m1) + mB) +- + + +m(E£p) +m(R,), (21) 


where the point set 

Ry = EBay t+ Ente + ol nd 
is also a measurable set by Theorem V. From (21) we have for all 
values of n 


mA, + He+- +--+ +Ha+: +--+) 2m(Ei) +m(f)+--: - 
+ m(E,). (22) 


As n increases, the right-hand member of this inequality can not 
diminish since the measure of each set added is necessarily zero or 
some positive number. Hence, 


mh+i,+: > ->+hat+: + -)2m(hi)+mh)+-: - 
+m(E,) +--+ -. (23) 
By comparison of the inequalities (20) and (23), we obtain 
mE, + Bo+- +> ->+Hat: + +) =m) +m(h) +: : - 
ae m( En) 35 ated oat 


which was to be demonstrated. 


TurorreM VII. Jf E,, E, are measurable point sets contained in 
(a, b) and E, > Ez, then E, — Eis measurable and 


m(H, — Ey) = m(E;) — m( 2). 


The point set (#; — E2) is composed of those points of EF, which 
are not points of H,. The complementary set C(H, — EF) is then 
made up of the points of #, and those points of (a, 6) not contained 
in £,, that is the points of C(E£,). We may then write 


C(E, — Ee) = C(Ai) + Fh, 
and hence we have 


mL C(E, — Ex) ] = m[C(E;) + Es]. (24) 
By Theorem VI, we have 
mL C(Ey) + Ex] = mlC(E1)] + m(E,). (25) 


Consequently, we obtain from (24) and (25) 
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Since EH, is measurable, C(E;) is also measurable. Then from the 
foregoing equation it follows that C(H, — H2) is measurable and 
consequently (#; — E;) is also measurable. By the addition theorem, 
we may then write 

m(E, — E2) + m(B2) = m(F,), 
or m(E, — E2) = m(E,) — m(F:), 


which was to be proved. 
For the limit of a sequence of point sets, we have the following 
theorems. 


TueoreM VIII. Jf we have given a sequence of measurable point 
sets contained in an interval (a, b) such that 


POPS as Rie RIE gad i RC mer ho 
then L m(E,) =m(Ei+ E2+- ++ +2Eat: + +). 
The sum Tipe ie fe se te BN ewe 


is composed of the points of H, and those of the succeeding sets 
which do not appear in the previous sets; that is, 
A,+ H+: ides +H,+: as =h,+(f,- fi) +: Tee 

Sis (EL, 7 E,-1) satcaeg 
The sum expressed in the right-hand member of this equation is also 
the limit of H, as n increases indefinitely. By Theorem VI we have, 
therefore, 


m(E, + HE. + - s -+#H,4+- . -) = m(F,) + m( EB, — E;) + - Oar 
4+ mB, —-— Ena) +> + += L m(Ea). 


THEOREM IX. Jf we have given a sequence of measurable sets con- 
tained in an interval (a, b) such that 


Deg Hig SEE cr Bec Tes me 
then L m(E,) = mB: Ee + + + -Ea + + °). 
Consider the complementary set C(H,-H,- - -). It includes all 
points of (a, b) which are not common to the given sets 
Hee aees He eal sx, 


and it therefore contains all the points which appear in the com- 
plementary set of each. We have then 
C( Ry» Be: + ~~ -En > - +) = C(Ei).+ C(B) + - > +. +C(E,) 

+ wero 
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Hence, we have 
mUC(Ey Ey + + + +Eqe + + *)) = m[CUE) + CUR) ++: - 
+ C(Ey) + + + J (26) 
Moreover, we have 
C(Ey) < CUh) ser CR ae 
Since E,, is measurable the complementary set C(E,) is also measur- 
able. From Theorem VIII, we have 


mUC(E;) + C( Hy) ++ + + +C(H,) ++ + -]= L ml Cn) I. (27) 
From (26) and (27), it follows that 
Lm CCR)] = mC Er ke OB 


Subtracting each side of this equation from the length of the interval 
containing the given sets, namely b — a, we have by aid of (7) 
L m(E,) = m(By: Ee: + + + «Ens + = *), 


which is the required result. 
Finally, we can establish the following more general theorem. 


THEOREM X. Given the sequence of measurable point sets Ey, 
Ex, + + +, Ha, + + + contained in an interval (a, b) and having the 
limiting point set E. Then E is measurable and we have 


L m(E,) = m(E£). 


In Art. 13 we have seen that the complete limit of #, of such a 
sequence of point sets can be expressed as the limit of the sum 


E,, =F Ena ae i cal pastas 
while the restricted limit is the limit of the product 
Ch eee 


As the given sequence has an unique limit, its complete and restricted 
limits must be the same and equal to its limiting set H. We have 
then from equations (1) and (2) of Art. 13 

E=L #,= (i+ ta fo =) (fas bee 


no 


B= L E,=((AiEs - + -) + (ie Es: - + >) 4 + 2). (29) 


The last member of the first of these relations is the product of a 

sequence of decreasing point sets, and hence by Theorem IX, we 

have 

LE mbn + Enit: ++) =m[((Ai+ F.+-- -) (Feo+F34+---) 
(Es + Be be) = en 
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From (28) we obtain 


m(H) = m(E,+ He+- + -) (Fat Bst- +--+). + -j 
and by comparison with (30), we have 
m(E) = L mE, + Enyit: + -). (31) 
But (Bina + >) 278, 


and consequently from (31) we obtain 
mE) = L m(E£,). 


In a similar manner we obtain from (29), by aid of Theorem VIII, 
mE) = L m(E,). 


Consequently, we must have ‘ 
mE) = L m(E,), 
as stated in the theorem. 
EXERCISES 


1. Can an isolated set be everywhere dense? be non-enumerable? perfect? 
have the measure zero? be dense in itself? have the cardinal number of the con- 
tinuum? have points of condensation? 

2. Can a set which is no subinterval everywhere dense have an outer content 
greater than zero? Illustrate your conclusion. [See Proceedings of London Math. 
Soc.., Vol. 6, p. 148.] 

3. Give a set, other than the continuum, having 3 as a limiting point. Is 
the set enumerable or non-enumerable? closed or open? Could it be neither 
closed nor open? Pick out the inner points, the boundary points. Are the latter 
identical with the limiting points of the set? 

4. Can a set have only inner points? only boundary points? TIllustrate. 
What relation do the boundary points of the set have to the complementary set? 
Can the boundary points of a set be also points of condensation? 

5. Is every set of the first category enumerable? Illustrate. 

6. Let EZ’ be a discrete set. Is H also discrete? everywhere dense? Must 
E be closed? Give reasons for your conclusions. 

7. Show that the sum Z of a finite or enumerably infinite number of enumer- 
able sets is a set of the first category. Can it be a perfect set? Can it be every- 
where dense? What can be said of the measure of H? Can it be closed? What 
statements can be made of the set C(Z)? 

8. An algebraic number of rank n is defined as a root of an irreducible al- 
gebraic equation of degree n, with rational coefficients, which is not a root of 
such an equation of lower degree. Show that the set E of all algebraic numbers 
is enumerable. Does this set EH include all rational numbers? Does it contain 
any irrational numbers? Is £ of the first or the second category? [See Young, 


Theory of Point Sets, p. 44.] 
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9. All real numbers that are not algebraic are called transcendental. Do such 
numbers form an enumerable set? How does the cardinal number of this set 
compare with that of the set of rational numbers? the irrational numbers? the 
continuum? Show that the transcendental numbers contained in the interval 
(0, 1) form a set of measure one. 

10. Can a perfect set be enumerable? isolated? consist of boundary points 
only? have the measure zero? Give your reason in each case and illustrate your 
conclusion. 

11. Could one obtain an enumerable set by suppressing from the continuum 
an enumerable set an indefinitely large number of times? Give your reason for 
the conclusion. Could one in this same way obtain a set of measure zero? 

12. If the derived set EH’ is enumerable, could one exhaust H by the continued 
separation of isolated subsets? Illustrate your conclusion. 

13. In case a set £ is dense in itself but not closed, show that H’ can not be 
enumerable but must have the cardinal number of the continuum. 

14. Could a closed set be enumerable? have a complementary set having the 
cardinal number of the continuum? have the measure zero? Llustrate each 
conclusion. 

15. Can a set of the first species be everywhere dense in a given interval? 

16. Do the irrational points form a closed set? an open set? What points 
are boundary points of the set? Does it have a closed subset? Does it contain 
points of condensation? Reconcile your conclusions with the statements of 
Theorem I, Art. 16, and Theorem III, Art. 17. 

17. Given the closed interval (0, 1) and let \ satisfy the condition 0 < \ <1. 
Drop from the interval (0, 1) and also in succession from the remaining free sub- 
intervals a portion of length J, (n = 1, 2,3. . .) satisfying the general condition 


that d 

Uy EDD s Atle es tie RR ee eee 

1+ 2, + 27l3 + +2741, = ares 
Let E be the set of end-points of the intervals {/,} plus their limiting points. 
Show that H is a perfect set and by the proper choice of \ may have any desired 
content from 0 to 1. 

18. Is the sum of a finite number of discrete sets necessarily discrete? Can 

such a sum be everywhere dense in a given interval? Illustrate. 


CHAPTER III 
CONTINUITY AND DISCONTINUITY OF FUNCTIONS 


22. Fundamental definitions. If a symbol may be assigned 
different numerical values in the course of a discussion, it is spoken 
of as a variable. The aggregate of real numbers constitutes the 
domain of a real variable. The results of any arithmetical opera- 
tion, other than the extraction of even roots of negative values, on 
a real variable is again a real variable. To the various values which 
such a variable may assume correspond the points on a straight 
line. We say that the variable 2 lies in the interval (a, b) if the 
values which x may take lie between a and b. If a and 6 are included 
in the interval, it is said to be a closed interval and we write 


(1S 4p Sola, 


If a and 6 are not included, we say that x lies in the open interval 
(a, b) and write eee 
We shall regard a given interval as closed unless otherwise stated. 

The elementary notion of a function dates from the seventeenth 
century,! and its early use was closely associated with the investiga- 
tions of Descartes and Fermat in the applications of algebra to the 
solution of geometric problems. Leibniz was the first to use the 
term function in a sense approaching its present use, and John 
Bernoulli and Euler were the first to introduce anything like a pre- 
cise definition. The definition which is now commonly accepted by 
mathematicians is due to Dirichlet and may be stated as follows. 

Having given two variables x and y, y is said to be a function of 
x if for each given value of x there is determined a definite value or 
set of values of y. We write y = f(x), and speak of x as the inde- 
pendent variable and of y as the dependent variable. 

It will be observed that the independent variable x need not take 
all values of the real continuum, and in fact a function f(x) can just 
as well be defined for a set of values {x} as for the continuum. What 


1 See Encyclop. des sci. math. II, 1, pp. 1-6. 
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is essential in the definition is that for every value which z does take 
there is uniquely determined one or more definite values of the func- 
tion f(x). If for any value of «x the function fails to have a definite 
value, then the function can not be said to be defined for that value. 
For example, 

y = sin 


is not defined for x = 0; for, when a takes the value zero the value of 
y is not definitely determined by this relation. If we assign to y a 
definite value for x = 0, say by putting 


f(0) a 0, 


then f(x) is fully defined for all values of z. 

A function f(z) may be defined for each value of x which enters 
into consideration, although one may not care or may not be able 
to write the function as an analytic expression of x. In other words, 
the functional relation may be stated otherwise than by means of an 
analytic formula. For example, f(x) is fully defined in the interval 
(0, 1) if we say that for all rational values of x in this interval it takes 
the value one and for the irrational values of x it has the value zero. 

The definition of a function may be generalized to include func- 
tions of two or more independent variables. Thus, we say that 


@ = f(z, y) 


is a function of the two independent variables x and y, if for each 
pair of values of x and y of a certain set { (x, y)} over which the point 
(x, y) ranges there is determined a definite value or set of values of z. 

The definition of a function as formulated leads to some general 
properties of the function itself.1_ In order to be made the basis of 
analysis, however, we shall need to know certain other properties of 
the function such as continuity, differentiability, etc., to be discussed 
later. 

If to each value of the independent variable there corresponds 
but one value of the function, then the function is said to be single- 
valued. If, on the other hand, two or more values of the function 
correspond to some or all of the values assigned to the independent 
variable, the function is called multiple-valued. In the discussions 


'Cf. Blumberg, New Properties of all Real Functions, Trans. Amer. Math. 
Soc. (1922), Vol. 24, pp. 113-128. 
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to follow, f(x) will be regarded as single-valued unless otherwise 
stated. 

A rational integral function or polynomial is a function of the form 

Oe Ge = Ea a A On, 

where a, di, - + - , d, are constants and n is a positive integer. 

By a rational function is understood the quotient of one rational 
integral function by another. Thus, if f(x) and ¢(z) are rational 
integral functions and ¢(z) is not identically zero, then 


F(z) = S() 


is a rational function. oe) 

If the relation between x and y is given by means of an equation 

of the form 

y” + filz)y" + folx)y’? +- - - +fn(x) = 0, 
where fi(x), fo(z), - - - , f,(x) are rational functions of z, then y is 
said to be an algebraic function of z. 

Functions which are not algebraic are called transcendental func- 
tions. The trigonometric functions, the exponential function, and 
the logarithmic function are illustrations of such functions. 

As we have seen, a functional relation between two variables is 
nothing else than an established correspondence between two sets 
of values. As x takes the values of one set, y = f(x) takes the cor- 
responding values of the other set, which may be regarded as a 
point set {y} on the Y-axis. If the set {y} is bounded, then the 
function f(x) is said to be bounded on the set {x}. The least upper 
bound of the set {y} is spoken of as the least upper bound of the 
function. Likewise, the upper limit of {y} is called the upper limit 
of the function. From the discussion in Art. 11, it will be seen that 
the two values may or may not be the same; that is, the least upper 
bound may be either the upper limit or an extreme value distinct 
from the upper limit. In case the least upper bound is a point of the 
set {y} it is called the maximum value of the function. Similarly, 
we can formulate the corresponding definitions for the greatest lower 
bound, lower limit, and minimum value of a function. 

We shall need later to consider the least upper bound and the 
upper limit of a sequence of functions {f,(x)}. For the purpose of 
definition, we shall make use of an auxiliary function $(x) defined 
as follows. For each particular value of x in the given interval, let 
(x) be the least upper bound of the corresponding set of values 
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{f,(v)}, disregarding the order in which the functions f,(z) may 
occur. The function ¢(x) thus defined for all values of z in the given 
interval is said to be the upper boundary function of the given se- 
quence of functions {f,(x)}. A similar definition may be formulated 
for the lower boundary function of the sequence. 

Denote by f(x) the function defined by the sequence {f,(x)}. 
If the sequence converges for a particular value of x, then the corre- 
sponding value of the limiting function f(x) is uniquely determined. 
For any value x=2, the sequence may fail to converge either by 
becoming definitely infinite or by oscillating between finite or infinite 
bounds. In case of oscillation, one may, by a proper choice of the 
values of n, make f,(vo) converge to any one of a closed set of values. 
The aggregate of the least upper bounds of these sets as x takes all 
values in the given interval is called the upper limiting function de- 
fined by {f,(x)}. In a similar manner the lower limiting function 
may be defined. In case the upper limiting function and the lower 
limiting function are the same, then the sequence has a unique 
limiting function. 

23. Definition of a limit. Ifa variable x is defined for a linear 
continuum and takes all values in the neighborhood of a definite 
number 2, we say that x has the limit 2 or approaches the limit 2. 
This use of. the term approach does not imply, however, any par- 
ticular order or succession in which these values are taken. It merely 
asserts that x may be assigned at pleasure any value in the neighbor- 
hood, deleted or not, of x. If the variable z is given for only a set 
of values H, then it is said to approach a definite value 2 if it takes 
all the values of # in the neighborhood of xo, provided of course that 
those values are dense at 2%». It is usual to indicate the fact that x 
approaches 29 by writing x— Xo, or by x = 2. 

Corresponding to the values of x in the neighborhood of x» the 
function f(x) takes a set of values which may also approach a definite 
limit A as x approaches a. The limit of a function may then be 
defined as follows. Having given an arbitrarily small positive num- 
ber ¢, if there exists a positive number 6 such that 


| f(z) - A| <e (1) 
for all values of x ¥ 2 which satisfy the condition | z — x»| < 6, then 


A is said to be the limit of f(x) as x approaches 2. Symbolically we 
also indicate this relation by writing 


En f(e) = A, 


LX 
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If the limit exists, it follows that we obtain the same limiting value 
if x is allowed to approach its limit through any particular set of 
values dense at xo as when it takes all values in the neighborhood of 
this point. If f(x) is defined for a set HZ rather than for the con- 
tinuum, then zo must be a limiting point of the set and x must take 
all values of # in the neighborhood of a». 

The existence of the limit does not depend upon the value of the 
function at the limiting point itself but depends entirely upon the 
values in its deleted neighborhood; that is, it is immaterial so far as 
the mere existence of the limit is concerned whether the limiting 
value A has any relation to the value of f(x) for x = x or in fact 
whether f(x) is defined for this value of x. It is essential to observe 
the order in which € and 6 are chosen, namely that € is chosen first 
while 6 is determined by that choice. The value of 6 therefore 
depends upon € and 2p. j 

The geometric significance of a limit may be shown as follows. 
Upon the perpendicular through the limiting point x = 2 locate the 


point y=A. On this same Y 
Zi, 


perpendicular lay off Ate. Ate 
eo 


Corresponding to the value 

of € there is determined a A-e 
positive number 6, and the 
existence of the inequality 
(1)means geometrically that 
for every value of z in the 
interval (2) — 6, x + 6) the 
corresponding value of f(x) lies within the rectangle bounded by the 
lines 


\\ 


5-0 


Fic. 10. 


y=Atre,t=%+ 6. 


The points representing f(x) are dense in the two-dimensional neigh- 
borhood of A. The value of € is arbitrarily small, and if its value is 
changed the value of 6 may change, but the existence of the limit 
is equivalent to saying that for every value assigned to ¢€ there 
exists a rectangle of area different from zero satisfying the foregoing 
conditions. 


Ex. 1. Given the function f(z) = sin S for « #0. Consider the limit as z 
approaches 0. 

This function is not defined for x = 0, but, as we have seen, the existence of a 
limit depends on the values of the variable in the deleted neighborhood of the 
point and not on the value at the point. In this case, however, the limit does 
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not exist as no value A can be found such that the inequality (1) is satisfied; 
for, in every neighborhood of « = 0 the value of the function takes all values be- 
tween + 1 and—1. This is also evident from the graph of the function, which is 
given in Fig. 11. 


Bree 11 


Ex. 2. Consider the limit as x approaches 0 of the function y = z sin as x #0. 
x 


The oscillations of the function in this case lie between the lines y = + x. 
The graph is given in Fig. 12. 


Die, 1A 


We have Ly sin + = (05 


n—-c 
for, assigning any arbitrarily small value to ¢, there exists a 6 > 0 such that 
Aue | ea! 
| isin 0] = | sin =| <6 


since the sine is at most equal to unity and 6 can be taken sufficiently small to 
make the product less than e. 


In Ex, 1 the limit fails to exist becatise in every neighborhood of 
the limiting point the function has an infinite number of oscillations 
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each of which is greater than a fixed positive number. The limit 
may also fail to exist for other reasons; for example, the limit of f(z) 
for values of x on one side of x2) may be different from the limit for 
values of x on the other side. The following is such a case. 

Ex. 3. Consider the limit as x approaches 5 of f(x) = aa F 


If we restrict x to values to the left of oy we have, by aid of Theorem I, Art. 24, 


1 
etanz _ | etanz j-—QO 
i Wir —————— 
ene + ] ™ 4 1 1+0 : 
Seti a5 Teena 


Hence, the limit Z f(x) can not be said to exist. 


T 
LI 


2 

If, as in the foregoing example, the function has a limit for values 
of the independent variable lying to the right of the critical point 
and to the left of it, it is often convenient to speak of these limits as 
the right-hand and left-hand limits; even though they may be: dif- 
ferent. We may indicate symbolically the right-hand and the left- 
hand limits at any point 2 by writing respectively 


-bi@), EF). 


If the function increases without limit, that is if it becomes infinite, 
as the variable approaches the critical point, then of course the limit 
does not exist, since there is no definite value A which satisfies the 
inequality (1). 

If we have given a function f(z, y) of two independent variables, 
limits of a kind different from those already discussed come into 
consideration. The variables may approach a limiting position either 
by varying separately or simultaneously. If (2, yo) is the limiting 
point, we have then the limits 

ils fa, 9), ale fay), Lf, y), 
y—Yyo LX LX 


ZX y—YVo 
y—Vo 


the last indicating that x and y approach their limiting values simul- 
taneously. We shall speak of the first two types as iterated double 
limits or simply iterated limits and of the last as a simultaneous 
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double limit or more briefly as a simultaneous limit. An iterated 
limit presents nothing essentially new, as it is merely a limit of a 
limit... However, in simultaneous limits we have something quite 
different from the ordinary simple limit. 

We say that the simultaneous limit L f(x, y) exists and is equal 


IX 
y—vo 


to A, if for an arbitrarily small positive number e€ there exists a 
positive number 6 such that we have 


ape ass (2) 
for all values of x and y in the neighborhood of (2, yo) defined by 
the inequalities | af: cecty |e erga ate tenes 


where the point (xo, yo) itself is omitted from consideration. 

As there are two independent variables, the geometric interpreta- 
tion is in three-dimensional space. It means that on the perpendicu- 
lar to the (a, y)-plane at (a, yo) there exists a point A such that, 
for an arbitrarily small ¢, there is in the (2, y)-plane a square whose 
sides are ie dO; ee 
such that for every point (x, y) other than (2%, yo) within this square 
the corresponding value of f(x, y) lies within a rectangular parallelo- 


Z 


AIGs oy 


piped having A as a center and bounded by the planes whose equa- 
tions are w=m+6,y=yt6,2=Axre. 


‘ Some writers take the position that the iteratedlimit L LL f(x, y) may exist 
xX yoy 


even though the limit L f(x, y) does not exist. Cf. Hobson, Theory of Functions 
yy 
of a Real Variable, Vol. 2, p. 383. 
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The existence of a simultaneous limit carries with it a wider range 
of consequences than is the case with single limits. For example, not 
only must we have the same limiting value if the variable point (2, y) 
approaches the limiting point (%,yo) through any set of values dense 
at that point, but we must also have the same limiting value as the 
variable point approaches its limiting position along any curve what- 
soever. Consequently, if we can find two methods of approach to the 
limiting point which give different limiting values, that is evidence 
that the simultaneous limit does not exist. This fact can often be 
used in determining the non-existence of a simultaneous limit. 


Ex. 4. Consider the simultaneous limit of f(z, y) = aan asz—>0, y— 0. 
If the variables be made to approach the origin along the line y = 2, we have 


upon putting y =z “2 1 
softs 2: 
If, however, we first allow x to approach zero along a line parallel to the X-axis 
and then allow y to approach zero along the Y-axis, we have 
ry 0 

y0 2-0 P+ y a y—0 Oy 
The different results obtained by these two methods of approach to the limiting 
point show that the simultaneous limit does not exist. 


= 0. 


If a simultaneous limit does exist, it follows that the limiting 
value obtained by assuming any convenient relation between the 
variables and allowing them to approach the limiting position along 
the corresponding curve gives the value of the limit. The converse 
is not true. For example, the same limiting value of the function 
may be obtained as the variables are allowed to approach their limit- 
ing values along all straight lines passing through the limiting point 
and yet the simultaneous limit need not exist. The following is an 
illustration. 

ry? 
ety 

If we put y = mz, which is the general equation of a line through the origin 
and then allow zx to approach zero we have 

m3 x4 Max? 
20 2? + mozs ~ 390 1+ mixt 
However, if we put x = 7° and then allow y to approach zero, we obtain 
y’ 1 
y—0 y+ y? en 
The simultaneous limit, therefore, does not exist; for, that requires that we obtain 
the same limiting value by all possible methods of approach to the limiting point. 


Ex. 5. Consider the simultaneous limit of ,asz— 0, y— 0. 
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If the simultaneous limit L f(z, y) exists, then the single limits 
yu 


L f(z, yo), L f(xo, y) also exist: It does not follow, however, that 
t—- 2X y—Yo ‘ 
the single limits L f(z, y), L f(x, y) exist for y A yo, © A XM, re- 
LIX y—Vo 


spectively, even for constant values of y and x differing ever so 
little from yo and 2. This statement is verified by the following 
illustration. 


; wu: ay gl 
Ex. 6. Consider the simultaneous limit of y sin A forz =0, y =0. 


We have L ysin - = (0p 


ey me 
for, we have |O-ysin =| =|ysin =| <r. OR <alers lee Onl eyes 
However, for any constant value of y ¥ 0, say y = y1, we have 
at Bia 
ME sin >= ie sin > 


But the limit ZL sin : does not exist, as we have seen (Ex. 1). 


a 


The inequalities (1) and (2) may be expressed in an equivalent 
form by means of the equations 


f(t) = A + €(), 
f(z, y) =Axt e(z, y); 


where € may be made as small as we please by the proper choice of x 
or in the second case of the independent variables x and y. 

24. Laws of operation with limits. From the study of elementary 
mathematics the reader is already familiar with many of the laws of 
operation with limits. The elementary laws of algebra apply so long 
as only a finite number of functions are involved. If we have an 
infinite number of functions it no longer necessarily follows that the 
sum, product, etc., of the limits of the separate functions is the limit 
of the sum, product, etc., of the separate functions. In such cases, 
as we shall see later, it is necessary to impose certain conditions upon 
the functions themselves and to study more carefully the manner of 
the convergence. There are certain other laws of operation with 
limits which we shall now consider. 


TuHeoreM I. If L Fy) = F(b), where y is such a function of x 
yo 
that L y(x) = 6b, then L F{y(x)} = F{ L y(x)}. 
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By hypothesis Le F(y) = F(b). (1) 
US 


Since y is a function of x, we have by substituting this function for y 
in F(y) another function of z, say f(x) = F{y(x)}. We also have the 
condition that y approaches 6 as x approaches a. Hence, we have 


L Fiy@)) = L fe) = LFW). 2) 
By the conditions given in the theorem, we also have 
FQ) = FLL yo}. (3) 
Hence, from (1), (2), (3) we have the desired result, namely 


EZ Fiy(x)} = F{ L y()}. 


The foregoing theorem is of value in evaluating the limits of 
certain functions such as the logarithmic, exponential, and trigono- 
metric functions. 
v+4 
z+2 

From the foregoing theorem the limit of the logarithm is the logarithm of the 
limit, provided the limit of the logarithm is finite and determinate at the point 
in question. Hence, in this case 


Ex. 1. Consider the limit as log 
z=—> 


lo si ea? he log 2 
z—2 Tee Shot o+2Q oa 
TuHeEoreEM II. Jf f(x) and (x) are two functions whose limits exist, 


a L (f(e)}# = {Lf}, 


z—a 


provided the latter limit 1s not indeterminate. 


Under the given conditions, we may write 


{ f(x) } OO = eF(2) low He), 


From Theorem I, we have 


L 1 
LY@)tO=]=LAort . pee og f(x) 
rlZ—a 


zI—a L o(a)log L f(z) 
= era ra. 
L (2) 
2a 


={ L fizx)} 


Z—a 


provided this result does not assume an indeterminate form. 
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Turorem III. A single-valued, bounded, monotone function has 
a left-hand (right-hand) limit at each point of its interval of definition. 


We shall demonstrate the theorem for the case of a monotone 
increasing function. The proof for a monotone decreasing function 
is similar and can be readily supplied. 

To each x there corresponds one and only one value of y, since 
f(x) is single-valued. The set {y} is bounded and hence has a least 

upper bound Q. As @ increases, 

there exists to the left of each 
point xz a deleted neighborhood 
xo—6 S x < X, for which f(z) either 
remains constant or increases. If 

f(x) remains constant, it follows at 
X once that the required limit exists. 

If f(z) is not a constant, then for 

every value of 6 > O there corre- 
sponds to the values of x in the foregoing neighborhood ‘of 2 an 
infinite set of increasing values of y which approach this least upper 
bound as x approaches 2. Since the function is monotone increas- 
ing, it follows that, in this case also, the left-hand limit L f(x) must 
exist. cae 

If x ranges over an infinite interval, it can be shown in a similar 
manner that the limit L f(x) also exists. It may be shown that the 


ICO 


%o-6 


Fig. 14. 


right-hand limit at 2 also exists. It does not follow, however, that 
the two limits are equal. In fact, one or both of these limits may 
ditfer from f(2o). 

Another theorem having important applications is the following. 


TuEorEM IV. If (x) and (x) have the same limiting value A as 
x approaches a, and if for all values of x in a sufficiently small neighbor- 


hood of a, we have Vo) Sia aoe: 
then it follows that L f(x) =A. 


Since the limits JE, ¥(x), L (x) exist and are equal to A, we 
have for x sufficiently near a 


V(x) = A+ 4, 
p(t) = A + &, 
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where €1, €2 are arbitrarily small positive numbers. Hence, for values 
of x sufficiently near a, we have : 


A+teEéSf(r)S Ate, 
or &s7f@) —Al| 2 a. 
Since this inequality holds for all values of x sufficiently near a, 
say for x such that | x — a| <6, it follows that 
lf@) — A] < efor|z-—a]| <6, 
where € is an arbitrarily small positive number, and hence 


Lila) = Ay 


sin x 
=1. 


Ex, 2. Prove that ZL 
Coe 


In the neighborhood of x = 0, we have 
Sings. tani, 


x 1 
or 1<- = : 
Sina’ = cOsia 
1 
But, we have L = mls 
250 COs tf 


Hence, from the theorem, we have 
x sin 2 


Sa yislive Mery ae 
The foregoing theorems have been established for the case of 
single limits. They may be extended to the case of simultaneous 
limits. The method of proof is similar to that for single limits and 
may be left to the reader to supply. There are also some theorems 
which are concerned primarily with simultaneous limits and iterated 


limits. The following is such a one. 
TuroreM V. If the simultaneouslimit L f(x, y) exists and ts equal 


2—X0 
y~yo 


to A and if the limit L f(x, y) exists for each constant value of y in 
the neighborhood of Yo and likewise the limit L f(a, y) exists for each 
y—yo 


constant value of x in the neighborhood of xo, then 
L L f(x,y) = L L f(x,y) =A. 
y—yo L—-Z0 


t—xm0 yy 
By hypothesis the limit LZ f(x, y) exists for each value of y in the 
neighborhood of y = yo. The aggregate of these limiting values defines 
a function F(x, y) of y. We may then write 
L f@, y) ee F (x0, Y), (4) 
zx 
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where F (zo, y) may or may not be identical with f(a, y). Stated 
as an inequality, this relation becomes, for each value of y in a 
neighborhood of yo, say in the neighborhood defined by the relation 


ly—yo| < 6o, 


| F(xo, y) — f(a, y) | < 4, | 2 —%| < o:. (5) 
From the existence of the simultaneous limit at (xo, yo) we have 
| f(x, y) - A| < e, |e — %| < 62, |y — yo| < oe. (6) 


Combining the inequalities (5) and (6), we have 
| F(x, y) — A | <é|y— y| <0; 


where 6 is the smaller of the two numbers 6o, 62 and 


€=€ + &, 
so that € is arbitrarily small. This inequality is equivalent to the 
relation mf F (20, y) =e Ae 
y~yo 


Replacing F(a, y) by its equal given in (4), we have 
L L f(x,y) =A. 
yyo xXL—xX0 


In the same way, we may show that 
L L f(,y) =A, 


z—x0 y— yo 
and hence we have finally 
L f@y= L 


y—yo 

This theorem states a sufficient but not a necessary condition 
for the interchange of the order of iterated limits; that is, there are 
cases where the order may be interchanged and yet the conditions 
set forth in the theorem are not satisfied. The following exercise 


gives an illustration of such a case. 


Lf@y= L L f@,y) =A. 
—yo y—yo LX 


y 


Ex. 3. Consider the iterated limits of Pa forz=0,y=0. 
As we have seen (Ex. 4, Art. 23) the simultaneous limit L ae does not 
: 0 y 
exist. However, we have 70 
xy 0 ae 0 
230 y50 Tc Ye 750 ge? 
jk xy 0-x 0 
’ 


y0 2-0 Pty JenOtay s 


and hence the order of limits may be interchanged. 
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A necessary and sufficient condition for the interchange of the 
order of iterated limits may be stated as follows. 


THEOREM VI. A necessary and sufficient condition that 
L L f(y) on L L f(x,y) 
Yo LX 


zmI—IXo yoyo 


1s: 
(a) 5 L f@, y) = oY), ¥ F Yo, 
Bee y) = Y(z), LF Xo; 
(0) ee) = 


(c) There exists a set of values y = {yn} dense at y = yo such 
that for each yn, n > m, there exists on the line y = Yn an interval 
(to — by, Xo + Oy,) which may vary with yn, and for every x within this 


interval, we have | f(z, yn) — V(r) | <e. 


We shall first show that the condition is necessary; that is, when- 
ever the interchange of limits is permissible the condition set forth 
in the theorem follows. From the assumed relation, 


L L f,y)= L L f@,y)=A 


ZI Y—Yo y—Vo 


the conditions (a) and (b) follow at once. We must show that con- 
dition (c) is also satisfied. We have 


LL f@y= L ¥@y-A4 


~~ Y—Yo 


which gives, when stated in the form of an inequality, 
| W(x) — Al< 5) |@— | < 6. (7) 
We have also L Lf(«,y) = ob Oy) = 


yyo L—-Zo 


and hence we may write for any set i dense at Yo 
| 4 - b(n) |< S lyn — yol <b. (8) 
Moreover, we have the limit 


m2 f(£, Yn) = b(n) 


and hence the inequality 


| bn) — f(t, ya) | < 3 |e — 0] < ds. (9) 
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Combining the inequalities (7), (8), and (9), we obtain 
| W(x) — f(z, yn) | < €, | @ — to] < Sy, 


where 6,, is the smaller of the two numbers 61, 63. This relation 1s 
that set forth in condition (c) of the theorem. 

The conditions of the theorem are also sufficient. The first of the 
conditions (a) holds for all values of x in every deleted neighborhood 
of x, say in (2 — 6),, 0 + 6;,). Hence, for the values of x in this 
neighborhood and for each value of yn in {yn} we have 


€ 

If, yn) — 60) | <5" (10) 

Since the limit (6) exists, then for values of y, sufficiently close to 
Yo we have € 

d(x) — Al <§ (11) 


For each y, we have from (c) for all values of x in an interval 
(xo — by,) to + 6,,) the relation 


| We) - fe, yn) | <5 (12) 


Hence, having chosen a y, sufficiently close to yo, we have upon com- 
bining (10), (11) and (12) the relation 


| ¥(@)- Al <e, (13) 


which holds for all values of x in the deleted neighborhood of x» defined 
by the smaller of the intervals (xo — 6,,, Zo + Syn), (to — 54, Lo + 6),). 
From this relation, it follows that 


L (2) =A, 


which is equivalent to saying that the order of the two iterated limits 
given in the theorem may be interchanged. 


If we now examine more closely the character of the function given in Ex. 2, 
we shall see why the iterated limits can be interchanged in that case. Conditions 
(a) and (b) of the foregoing theorem are satisfied; for, we have 


xy 


pip BP ee ee 
ry ci ™& 
0 Bey 0 7 Ve) 2 #0, 


fa Pay = 0. 
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The third condition of the theorem is also satisfied. On each line y = yp, 
where {yn} is any set of values of y dense at y = 0 there is an interval (0, 6,,), which 
varies with yn, such that for each value Z 
of x in the interval, we have 


| #@ Yn) — Yn) | <e. 

As the condition (0) is satisfied, we have 
| dyn) -O| < el yn| < 6. 
From the fact that f(z, y) =0 for all 
values of x on the line y = 0, we have 
|O-yY(z)| <e. 

By combining these three inequalities a 
we have the desired result 

| F(, yn) — We) | < 36, Fre. 15. 
for all values of x within the interval (0, 6,,). Hence, the conditions of the theorem 
are all satisfied, and the order of the limits may be interchanged as we have seen. 


In certain theoretical discussions it is useful to have the following 
form of the necessary and sufficient condition for the existence of a 
limit of a function. 


THEOREM VII. A necessary and sufficient condition that the limit 
L f(x) exists is that for an arbitrarily small positive number e there 


xr—2X 
exists a positive number 6 such that for any two points x, &, distinct from 
ao, in the interval (9 — 6, X + 6) we have 


[f@) — fla) | <e. (a) 
That the condition is necessary follows at once. For, if the limit 
L f(x) exists, we may write 


gt i) - A| <§ |2-m| <6, 


JA -f@| <5 |F-m1 <6. 


Combining these inequalities, we have 
f(a) —f@) | <€|2-m| <6, | z-m| <6. 


To show that the given condition is also sufficient, we assume that 
the inequality (a) holds for all values of « and z, other than 2 itself, 
in the interval (z — 5, x + 6). On the basis of this assumption, 
we must show that there exists a definite point A on the line x = 2% 
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toward which the values of f(x) tend as x is made to approach 2; 
that is, we must have 
[f(@) -A|<<«¢, ]|x—am| <6. 
Let {7} be a sequence of decreasing, positive numbers such that 
L m. = 0. 
kw 


Then, from (a) it follows that if we assign the value 7 to the arbi- 
trary number e, there must exist a positive number 6, such that we 


have a 
| f(x) — f(z) | << My; 
where ty — 01 SEF S005 Ly — 01 = EX Bo a to + 01. 


Then, if a, is any point other than 2 in the interval (x — 61, to + 61), 
it follows that the values of f(x) for any x ¥ 2 in this interval must 
lie between f(a) — m and f(a1) +m. The lines 


Pie SSS [7] 


a 


— 


ee 
Fia. 16. 


y=f(a) —m, y=fa) +m 


cut from the line x = 2 an interval (c, d:) whose length is 2. 

Again, if we assign to € the value 72 < m, we have in the same way 
an interval (% — 62, % + 62) such that for values of x ¥ 2p in this 
interval the corresponding values of f(x) must lie between f(a2) — m2, 
f(a) + N2, f(az) being the functional value at some point a, ¥ 2% 
in (2 — 62, X) + 62). The lines 


y = f(a) — m, y =f(a2) + m 


determine on x = % a second interval (c:, dz) of length 2m. If it 
happens that either extremity of this interval falls outside the in- 
terval (ci, di) we select as the interval (c, dz) that portion common 
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to the two intervals, as indicated in Fig. 16, in which case the length 
of the interval is less than 27). In a similar manner by assigning to € 
the value 7; < m2 we are led to a third interval (cs, ds) ON & = 2 Of 
length not greater than 273 and lying within the interval (C2, dp). 
Continuing this process we obtain on x = ao a sequence of intervals 


(a, dy), (ca, de), (ca, ds), Bate ne: (Ch, dx), nae: (14) 


each lying within the preceding. The limit of the lengths of these 
intervals is zero, since (cx, di) can not exceed 27, which has the limit 
zero. ‘The sequence (14) then defines uniquely a point A on x = 2. 
This point A les within all of the intervals (c, d,) however large 
k may be chosen. 

Corresponding to each interval (c;, d,) there is on the X-axis a 
definite interval (x — 6;, xo + 6x) of length greater than zero such 
that for each point x within it the value of f(x) differs numerically 
from the value of the ordinate at any other point of (a — 6%, Xo + 6x) 
by less than 7;, provided the upper extremity of that ordinate lies 
between the lines 


y = f(ax) — m. and y = f(ax) + ne. 
As the point A on the line x = 2p satisfies this condition, we may write 
| f(a) —A| <= Nk; to — On SEX MS M+ O:, 


where 7; may be made arbitrarily small by the proper selection of k, 
and 6; is different from zero. Replacing the arbitrarily small number 
mn. by € and 6; by 6, we can express the foregoing result in the re- 
quired form, thus establishing the theorem. 

The corresponding theorem for simultaneous limits involving two 
independent variables may be stated as follows. The proof is similar 
to that of the foregoing theorem. 


TueorEemM VIII. A necessary and sufficient condition that the 
simultaneous limit L f(x,y) exists is that for an arbitrarily small 


LX 
y—Vo 


positive number € there exists a positive number 6 and a region 
(om —-6 Sea Sm+6, yw—8 Sy Syd) 


such that for any two points (2, y), (, y) in this region exclusive of 


aa iGo <6 
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25. Continuity and discontinuity of a function. Closely asso- 
ciated with the notion of a limit is that of the continuity of a function. 
We say that f(x) is continuous | at the point x = x if we have 


rep f(z) = f (0), 


or what is the same thing, f(x) is continuous at 9 if for an arbitrarily 
small positive number € there exists a positive number 6 such that 


| f(x) — f(a) | < € |" — 2] < 4. (1) 


This definition involves the condition that the limit shall exist and 
that its value shall be the value of the function at the point in ques- 
tion. As we have seen, the mere existence of a limit does not require 
that the function be defined at the limiting point, since it depends 
only on the values of the function in the deleted neighborhood of 
that point. For the continuity of a function, however, it must be 
defined at the limiting point. 


The function sin < is not defined for x = 0, since for this value it 


does not have a definite value. If we assign to it some value at this 
point, say the value zero, we may then consider its continuity at 
that point. This function is discontinuous at the origin; for, as 
we have seen, the limit Z sin : does not exist. On the other hand, 

z—0 " 


the function x sin : does have a limit, namely zero, as x approaches 


zero. If we assign the value zero to the function at the origin, it is 
continuous. Discontinuity may also occur if the limiting values are 
different on the two sides of the critical point as the following illus- 
tration shows. 


Ex. 1. Consider the continuity for x = 0 of f(z) = Heise 
1-@ 
The right-hand limit gives L : ; = 0, 
z—0+ 1 — @ 
while the left-hand limit gives 
1 1 
L = Ih aia 4. 


z—0-1—- @= 0s we = 
éz 
Since these two limiting values are different, the limit as x approaches zero can 
not be said to exist. Hence, the given function is discontinuous at the origin. 


' The first precise definition of continuity was given by Cauchy in his Analyse 
algebraic (1821). 
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Ex. 2. Consider the continuity of f(x) = L 2%, where t+ a n being an integer. 
t-0 


This function is fully defined, as it is 0 for z = 0 and + 1 for all other values 
of «. Here, the limit f(x) exists and is equal to +1, but as that is different 
Sree 


from the value of f(x) at x = 0, the given function is discontinuous. 


If at a point of discontinuity 2 the right-hand and the left-hand 
limits of the function both exist but are distinct; that is, if 


ft +0) = L f@) #fla-0)= L fe), 


then f(x) is said to have an ordinary discontinuity, or a discontinuity 
of the first kind. 
If we have f(Xo + 0) = f(xo — 0) F¥ f(a), 


then the discontinuity is often spoken of as a removable discontinuity ; 
for, we can always make 2 a point of continuity by assigning to f(z) 
at that point the common value of the right-hand and the left-hand 
limits. 

If either the right-hand limit or the left-hand limit or both fail to 
exist at vo, then the function is said to have at 2 a discontinuity of 
the second kind, no matter what value be assigned to the function 
at this point. Thus the function 


f(x) = sin se ~ 0, 
= 0, x=0 


has such a discontinuity at the origin. 

If the limit of the values of the function on the right of the limiting 
point x = 2 is the same as the value of the function at the point, the 
function is said to be continuous on the right of x. In a similar 
manner a function may be continuous on the left of x. In order to 
be continuous at the point zx) the function must be continuous both 
on the right and on the left of the point. Of course a function may be 
continuous on one side and have a discontinuity on the other due to 
the non-existence of the limit of the function or to the fact that the 
function has a value at the point different from the value of the limit. 
Likewise it may have a discontinuity on one side due to the non- 
existence of the limit, and on the other side a discontinuity due to 
the difference of the limit and the value of the function at the point. 
In other words, a function may be continuous on the one side and 
have a discontinuity of either the first kind or second kind on the 
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other side, or it may have a discontinuity of the first kind on the 
one side and one of the second kind on the other side. 

A function is continuous in an interval if it is continuous at all 
points of the interval. If f(x) is continuous in a closed interval (a, 6), 
then the least upper bound of f(x) in (a, 6) is identical with its upper 
limit in this closed interval. So likewise the greatest lower bound 
and the lower limit are identical. On the other hand, if f(x) is known 
to be continuous merely in the open interval (a, 6), then one can not 
make the foregoing statement concerning the equality of the upper 
limit and the least upper bound in the closed interval. In fact, there 
may, in this case, be neither a finite upper limit nor a finite upper 
bound, or both may be finite and different. A similar statement may 
be made concerning the lower limit and the greatest lower bound. 

We shall have occasion to measure the amount of discontinuity 
which a bounded function may have at a given point 2%. Suppose we 
have an interval (a, b) containing the point %. The function f(x), for 
a <x < b, hasa least upper bound which we shall denote by M(f, ab). 
Similarly, the greatest lower bound of f(x) for this same interval exists 
and may be denoted by m(f, ab). The oscillation w(f, ab) of f(x) in 
the closed interval (ab) may then be defined by the equation 


w(f, ab) = M(f, ab) — m(f, ab). (2) 


Consider now a neighborhood of the point 2, say (vo — 6, 2 + 4), 
lying within the interval (a, 6). As 6 is allowed to decrease, the value 
of M(f, 6) never increases, and that of m(f, 6) never decreases. 
Moreover, we have for all values of x in this interval 


M(f, 8) = fo), mF, 6) S f(a); 


that is, both M(f, 6) and m(f, 6) are not only monotone, but the first 
has a finite lower bound and the second a finite upper bound. Both 
have a limit as 6 approaches zero and we shall denote these limits by 
M(f, Xo), m(f, Xo), respectively. The two values M(f, 2), m(f, xo) 
are often spoken of as the maximum and the minimum values, re- 
spectively, of f(x) at the point 2. The maximum value M(f, 2») is 
the largest of the three numbers, f(x), the upper right-hand limit 
f(%o + 0), and the upper left-hand limit f(x — 0). Similarly, the 
minimum value at 2, namely m(f, 2) is the smallest of the three 
numbers, f(%o), f(t +0), f(xo — 0), 


The relation 
w(f, Xo) = M(f, Xo) —y m(f, Xo) (3) 
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is important in telling us of the behavior of f(x) as to continuity at zp. 
If the interval (a) — 6, a + 6) is regarded as the deleted neighbor- 
hood of a, then w(f, xo) is called the oscillation of f(x) at the point Xp. 
In this case the value of w(f, xo) is not affected by any value which 
may be assigned to f(x) at xo or indeed whether the function is even 
defined at that point. If f(x) is defined at 2 and its value at this 
point is taken into account in determining M(f, x), m(f, xo) , we shall 
then speak of w(f, 2) as the saltus of f(x) at 2.1 

It follows at once that if the saltus at a point is zero the function 
is continuous at that point, and conversely if it is continuous the 
saltus is necessarily zero. Neither the oscillation nor the saltus is 


: Pane - ual E 
ever negative. For example, the oscillation of sin ‘ at x = 0 is 2, and 


for the function it is 1 at the origin. For each point 2» of an 


— 
interval there are then defined three numbers M(f, 2), m(f, 2), 
w(f, 2), satisfying the relation (3). 

We have thus far spoken of the continuity of a function at a point 
with respect to the entire continuum. We may also speak of the 
continuity of f(x) with respect to a given point set / for which it is 
defined. Thus, f(x) is continuous at the point 2 with respect to the 
set of points F, if the definition of continuity is satisfied as x ranges 
over this set rather than over the continuum. In order that it be 
continuous at each point of #, each such point must be itself a limit- 
ing point of #, that is # must be dense in itself; for, it is only at such 
points that the notion of continuity can have any significance, since 
at an isolated point the limit can not be said to exist. The set # need 
not be closed; for, at those limiting points of 4 which are not con- 
tained in H the given function is not defined. Likewise the set # need 


1 The distinction between the oscillation at a point and the saltus may also 
be made clear by use of the upper and lower right-hand and left-hand limits 


Le f(x) = f(@o +0), L S@) =f@-9), 
L f(t) =f(%o+0), L. f(x) = f(z —0). 
L—xXot+ L—I9- 


Thus the oscillation at 2» then becomes the excess of the largest over the smallest 
of the four numbers f(z + 0), f(z — 9), f(ao +9), f(ao — 0), while the saltus is 
the excess of the largest over the smallest of the five numbers f(x» + 0), f(to — 9), 
f(to +0), f(z — 9), f(a). [Cf. Hobson Functions of a Real Variable, 2d Ed. 
p. 284.] The Encyclop. des Sci. Math. uses the term vibration for oscillation at a 
point, [I]2, p. 62]. Baire uses “ oscillation at a point” in the sense of saltus as 
defined above [see Legons sur les fonctions discontinues, p. 71]. 
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not be everywhere dense in the given interval; for, we may have 
continuity relative to any perfect set and, as we have seen (Art. 17), 
such a set need not be everywhere dense in any portion of a given 
interval. : 

A function f(x) is said to be absolutely continuous‘ in a given 
interval (a, b), if for every finite or enumerably infinite set of non- 
overlapping intervals in (a, b) the sum of the oscillations of f(z) in 
these intervals tends to zero with the sum of the lengths of the in- 
tervals. From this definition it follows that any function which is 
absolutely continuous is also continuous in the ordinary sense. The 
converse of this statement, however, is not true. For example, the 
function 


f(z) = sin 5 for « # 0, 
= 0, forz = 0 
is continuous in the interval (0, 1), but it is not absolutely continuous. 
: 1 1 
In each of the subintervals (= Eel Kee 123. ave eee 


oscillation of f(a) exceeds The sum of the oscillations in 


(k + 2)r 
the enumerably infinite set of subintervals to be found in the neigh- 


borhood (0, -.) of the origin, is greater than 


2 2 2 if 1 
yer eee I 
But, however large n may be chosen, and hence however small the 
neighborhood may be, the sum of the oscillations exceeds any finite 
bound, since the infinite series in the brackets is divergent for every 
value of n. Consequently, the given function can not be absolutely 
continuous. 

The notion of absolute continuity can be extended also to functions 
defined for a set of points. Thus f(z) is absolutely continuous on the 
set of points H, provided that for every subset EL, of HZ the sum of the 
oscillations of f(x) tends to the limit zero with the measure of Fj. 

Suppose we have given a function f(x) which is continuous through- 
out the interval (a, b). For a given, arbitrarily small positive number 
€, there is then determined a positive number 6, which may vary with 
wo, such that the conditions set forth by the inequality (1) are satis- 


* Such functions were first defined and their properties discussed by Vitali. 
See Atti della R. Accad. delle Scienze di Torino (1905), Vol. 40, p. 1021. 
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fied for each constant value 2 in (a,b). For a fixed value of € this 
6 is, as already pointed out, a definitely defined function of a. The 
aggregate of values of 6(x) as a takes all values in the interval 
(a, 6) has a greatest lower bound. If, for a fixed but arbitrarily small 
value of €, the lower bound of 6(ao) is different from zero, then f(x) 
is said to be uniformly continuous in the interval (a, b); for, this 
lower bound 6’ may be associated with the chosen € uniformly for 
all values of 2 in (a, b). In other words, there exists in this case a 6 
independent of 2» which together with € satisfies the conditions of the 
inequality (1) defining continuity for eack choice of a in the given 
interval. 

As we have seen, a given function may be discontinuous at a single 
point. As the following illustrations show, it may also be discon- 
tinuous at a set of points. 


Ex. 3. Given the function 
(1 + sin 72)? — 1 


ie) = too (L+sin rz)§'+1 


Show that f(z) is discontinuous at the points 


ee a ISO ERS Ske 5 EP 
(1+0)é-1 
=n Ww Si aa ee es (), 
Forz=n,wehave f(z) eo (+0) +1 
For x = 2%, where 2n < x < 2n +1, we have 
0 <sin 7% <1, 
hs oot Nee 
1 + sin 7x) —1 ~ (1 + sin 12)! 
h = (isin wa)? — 1 = —<——— = |, 
and hence f(z) Cee Tx)’ +1 244 1 


(1 + sin 72%)? 
On the other hand, for « = 2», where 2n + 1 <a < 2n + 2, we have 
—l=sn 7% < 0, 


(1+ sin may)!—1 _ 
and hence f(z) = a ( +sin 7a)t+1— 


The function therefore has a discontinuity of the first kind at z=0,1,2,..., 
and the graph is given in Fig. 17. 


-1. 
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Ex. 4. Given the function f(z) = LZ ¢,(x), where 
no 


DeCreenee sin? n! rar 
pg sin? nl wz + 2 


Show that f(x) is totally discontinuous. 
Let us first consider f(x) for rational values of x; that is, let x = P, where D 


and q are integers prime to each other. By taking n sufficiently large n! mz is an 
integral multiple of 7 for any given value of z. We need at most to put 7 = g. 
For any such value of x, we have 


sin n! wx = 0, 
sin? n! 1a 0) 


and hence f(x) = now t30 Sint nl re + # " Woo eo Ose 


0. 


If x is irrational, we have x # and hence for all values of m however large 

we have sin? n! rx > 0. 
sin? n! rx 1 1 
x) = ——————_= L - = 
F(z) eco FO SA TUN et pe can tO ? 1+0 

sin? n! 12x 

Since f(z) is 0 for all rational values of x and is 1 for all irrational values, it is 
totally discontinuous; that is, it is discontinuous for every value of zx. 


In between the class of functions which, like the foregoing, are 
totally discontinuous and the class of continuous functions there is a 
class called point-wise discontinuous functions. A discontinuous 
function is said to be point-wise discontinuous in a given interval if 
the points of continuity are everywhere dense but do not form a closed 
set. Such a function has then points of continuity in every interval 
however small, but in every such interval there may be also points of 
discontinuity. The class of point-wise discontinuous functions forms 
a very important class and their properties will be frequently used 
in the discussions to follow. 

Thus far we have discussed the continuity of functions of a single 
variable. The consideration of the continuity of functions of several 
independent variables involves simultaneous limits. Thus, we say 
that f(z, y) is continuous at the point (2, yo) if 


hai f(z, y) ers f (Xo, Yo). 


y— Vo 


1 First discussed by Hankel, who was the first to classify functions as continu- 
ous, point-wise discontinuous, and totally discontinuous and to discuss the 
characteristic properties of discontinuous functions. See, Untersuchungen tiber 
die unendlich oft oscillierenden und unstetigen Funktionen, Tibingen (1870); also 
Math. Ann., Vol. 20 (1882), p. 89. 
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By continuity here is meant, of course, continuity with respect to the 
two variables taken together. Stated in the form of an inequality, 
f(z, y) is continuous if for an arbitrarily chosen €, there is determined 
a positive number 6 such that 


| f(x, y) —f(®o, yo) | <€,|e2-—2%| < 6,|y—y| < 6. 


Instead of being continuous with respect to z and y together, f(z, y) 
may be continuous in x and in y separately; that is, the functions may 
be continuous in x for constant values of y or continuous in y for 
constant values of x. Continuity of this latter kind does not involve 
continuity with respect to the two variables together. However, if a 
function is continuous in the two variables together it is of course 
continuous with respect to each variable separately. 


Ex. 5. Consider the continuity at the point (0, 0) of f(z, y) = Hae 1x0 0, 

= 0, wheres p0) 0) <0, ey: 

The simultaneous limit L f(x, y) does not exist; for, if we allow the vari- 
a 

ables to approach the limiting point by first permitting x to approach zero while 

y remains constant and then permit y to approach zero we get the limiting value 

zero. On the other hand, if we permit the variables to approach zero along the 


= 
path y? = x, we have ~ 1 
y—0 yf oF y’ 2 


Consequently, f(z, y) isnot continuous at (0,0) in (z, y) together. It is, however, 
continuous in z alone and in y alone at the origin. For, putting either variable 
equal to zero and then allowing the other to approach zero we have the limiting 
value zero, which is the value of (0, 0). 


In order that f(x, y) shall be continuous in both variables together, 
it must have the same limiting value by all possible approaches to the 
critical point. A necessary and sufficient condition for continuity 
therefore involves the condition that the function is not only con- 
tinuous in each direction but the continuity is uniform for all direc- 
tions. For, if we put 


L=X%+pcoshy=yrt+psind, 
we have from the definition of continuity 
| f(to + p cos 0, Yo + p sin 0) — f(x, yo) | < «, 


which must hold for all values of p less than some number pp which is 
independent of 9. This is equivalent to saying that the transformed 
function must be uniformly continuous in p for all values of | 6 | S 27. 
The following example will illustrate this condition. 
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Ex. 6. Consider the continuity at (0, 0) of 
a 
{@ y) == 


Putting x = p cos ae y=p ae 6, we obtain 


p? cos 6 sin 0 eRe! 
pvsin? 0 + cos? 6 5 


fa y ~ 0, where f(0, 0) =0 


f(p cos 0, p sin 8) = 
which is arbitrarily small if we take 


2€ 
= 2€- 20. 
<a 2e-csc 26 


Since ese 26 is never less than one, it follows that if we put po = 2¢, then however 
small € may be chosen f(p cos 9, p sin @) is always less than € for all values of 0 
and for p < fo; that is, at all points within a circle about the origin and with a 
radius py) = 2e. The transformed function is, therefore, uniformly continuous 
in p for all values of 6. Hence, the foregoing criterion is satisfied and f(z, y) is 
continuous in (z, y) together at the origin. 


It must not be inferred that because 
L f(to + p cos 6, Yo + p sin 6) =f (Xo, Yo) 
p> 


for each value of 6, the function is necessarily continuous. For 
example, it has been shown (Ex. 5) that the simultaneous limit of 


(Qty) = arias 0, y x 0, where J(0, 0) = 0, 


as x and y erate zero does not exist. This function is, therefore, 
discontinuous at the origin. However, we have after introducing 
polar codrdinates 
p* cos 6 sin? @ > COS 6 sin’ 6 
Sei ie ey ae rae SS | Py 
p—0 p* cos”0 + p®sin*@ p50 §©6cos? @ + pt sin’ 6 


= 0 = f(0, 0) 


for each constant value of 6. 

The terms oscillation, uniform continuity, point-wise discontinu- 
ous already discussed for functions of a single variable can be at 
once extended to functions of two or more independent variables. 
All that is necessary is to replace the term interval by region in the 
previous definitions, it being understood also that continuity here 
has reference to the several variables taken together rather than to 
that of each separately. The measure of discontinuity or saltus of a 
function at a point is, as in the case of a function of a single variable, 
the difference between the maximum and the minimum values of the 
function at the point in question. It is always equal to or greater 
than the difference between any two limiting values at the point. 
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Ex. 7. Show that the saltus of the function f(x, y) = 
where f(0, 0) = 0, is infinitely large at the origin. 
We have from the iterated limits 


cy 
= = LO=0 
230 yot+y® 50 ‘ 


xy 
Bag OY ~ 0, 


while putting z = y2 and then passing to the limit, we have 
piieue. fil 
y—0 2y8 i yoo2y? 
26. Properties of continuous functions. Having defined a con- 
tinuous function in terms of a limit, the laws of operation with limits 
apply to such functions. Thus the sum, difference, and product of a 
finite number of continuous functions is a continuous function. The 
quotient of one continuous function by another is continuous at any 
point at which the denominator is not zero. It follows also that any 
rational function is continuous at all points where its denominator 
does not vanish. Functions which are continuous in a closed interval 
satisfy the following theorem. 


= C25 


TueoreM I. Jf a function f(x) is continuous in a closed interval, it 
is uniformly continuous in that interval. 


From the continuity of f(x) we have 
[ f(x) — fl) |<¢|]2-2| <6. 

The value of 6 depends upon ¢ and also upon the choice of 2. If 
(a, 6) is the given interval, then for each value of € there is asso- 
ciated with every point z in (a, b) a definite value 6(x). The aggre- 
gate of all these values has a greatest lower bound 6’, which we wish 
to show is different from zero under the conditions set forth in the 
theorem. Since the interval (a, b) is closed it must contain at least one 
point such that in every neighborhood, however small, of this point 
the greatest lower bound of 6(z) is 6’.. Let x, be such a point. By 
hypothesis f(z) is continuous at x; and hence we may write 


€ 
| f(z) — fl) |< OY 
which is satisfied by each value of x in an interval (x — 61, a1 + 61). 


Then, in the interval (« — 2 Y + =) the oscillation of f(x) can, of 
course, not exceed €. Moreover, for a given ¢, there is associated with 
each point x of this interval a value of 6() which is at least equal 


to a - The greatest lower bound of 6(z) in this interval is therefore 


equal to or greater than St which is, as we have seen, greater than 
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zero. Since the greatest lower bound of 6(x) for the interval (a, b), 
namely 6’, is the greatest lower bound of 6(x) in every arbitrarily 
small neighborhood of 21, it follows that we have 


, Ot 
25 >0, 
which establishes the theorem. 
It is essential to the validity of this theorem that the interval 
(a, b) of continuity be closed. If it is not, the greatest lower bound 


of the 6(x) may be zero. Such is the case for the function 
fz) =* Oe Ee 


This function is continuous in the given interval, and hence for any 
arbitrarily chosen € there exists for each x a 6(x) > 0 equal to the 
smaller of the two num- 
bers 6:(x), 62(x), as shown 
in Fig. 18. The function 
6(z) has the greatest 
lower bound zero as x 
takes all values in the 
neighborhood of the ori- 
X gin, as may be seen from 
the graph of the func- 
Fia. 18. tion. 


O} xd, % Ltd 


TurorEeM II. Jf f(x) 2s continuous in a closed, finite interval (a, 6), 
then this interval can be divided into a finite number of subintervals 
in each of which the oscillation of f(x) is less than an arbitrarily chosen 
number €. 

From Theorem. it follows that however small € may be selected 
there exists a positive number 6 independent of x such that the 
oscillation of f(#) in every interval (« — 6, x + 4) lying in (a, d) is less 
than e. Since 6 is greater than zero and any point zx of (a, b) can be 
taken as the center, it follows that a finite number of such subinter- 
vals is sufficient to cover the given interval (a, b). 

This theorem also follows as a consequence of the Heine-Borel 
theorem, as the reader may readily show. 


TueoreM III. If the values of a continuous function f(x) are known 
for a set of points everywhere dense in the interval (a, b), then the value 
of f(x) ts determined for all points of (a, b). 
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Since f(x) is continuous, it follows that the limit L f(x) exists at 


=I—IXo 
any point 2 in (a,b). The value of this limit is determined if we 
allow x to approach x through any set of points dense at 2. Since 
the given function is known for a set of points everywhere dense in 
(a, 6), it follows that its value at each point % of (a, b) is given by 


the limit : Le f@) =F), 


where {z,} is any set dense at 2». 

Thus, if a given function is known to be continuous and its values 
are known for the rational points or the irrational points, its values 
are determined at every point. If a continuous function has the 
same value at a set of points everywhere dense, it is fully defined and 
is everywhere a constant. 


TuHeorEM IV. [f f(x) ts single-valued and continuous in the closed 
interval (a,b), then there exists a definite point xo of (a,b) at which 
J (x) takes its maximum value. 


As the given interval is closed and the function is continuous, it 
follows, as we have seen, that 
f(x) is bounded and its least 
upper bound in (a, 6) is iden- 
tical with its upper limit. De- 
note the upper limit of f(x) by 
M. Weare to show that there 
is a definite point 2 of (a, b) 


where 4.) — M. Fra. 19. 
To do this, we divide the given interval (a, b) into the subintervals 
(a,a+ 1), (a+1,a+2),- : -, (a +n, d), 


where all, with the exception of at most the last, are of unit length. 
In each of these subintervals f(x) has an upper limit. None of these 
upper limits can exceed M, and there must be at least one sub- 
interval in which it is equal to M. As 2 increases from x = a, sup- 
pose the first interval encountered in which f(x) has the upper limit 
M is (a +aQ,4+Q+1). Divide this interval into 10 equal parts 
and in at least one of these subintervals, say 


a+at+l t) 


at+Qo 


Ou m1 
(a+ co + Sh a + oo + H+ 35), 
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f(z) has the upper limit M. Divide this interval likewise into 10 
equal parts and proceed as before, continuing the process indefi- 
nitely. We obtain in this manner two auxiliary functions 


Qi | O Xn 
din) =atam+itigt: ° T 70% 

OH , A es Ne 
¥(n) =a+at+ 7+ 7+ 10" * jo 


For values of x such that 


p(n) SxS Yn), 
the function f(x) has the upper limit M@. As n increases indefinitely 
o(n) and W(n) both approach a limit, since both are bounded and 
monotone. Moreover, their limits are the same, since their difference 


a approaches the limit zero. We may then write 
L p(n) = L Yn) = 2. 


In other words, f(x) approaches the upper limit M as x approaches 
Xo; that is, L f(z) =M. 


ea) 


But f(x) is continuous at 2x» and hence 
LL S(e) = f(a). 


It follows from these two relations that 
f(x) = M, 


as the theorem requires. We may speak of this upper limit M as 
the maximum value of the function since this value is also the least 
upper bound of the function and is a value of the function itself. 

In a similar manner we may show that a function which is con- 
tinuous in a closed interval takes on its minimum value at some 
point of the interval. 


TuHroreM V. If f(x) 7s a continuous function in the closed interval 
(a, b), then as x takes all values between a and b, f(x) takes at least 
once all values between f(a) and f(b). 


Without loss of generality we may assume 
f(a) > f(0). 
On the X-axis locate the points 
at+il,a+2,a+3,-°+-:. (1) 
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Let yo be any point on the Y-axis between f (b) and f(a). It is to be 
shown that for some definite value of x the function f(x) has the 
value yo. If yo happens 


to be the maximum or f Fe 
the minimum value of 
f(x) in any of the sub- 


intervals made by in- 
serting the points (1), 
then by Theorem IV 
there exists a point 2» 
of the given interval a@ atlat2 G+ao ataotd 
for which f(x) takes the 
value Yo. 

In case yo is not the maximum or the minimum value of f(x) in 
any of the subintervals made by the insertion of the points (1), then 
in at least one of these subintervals, say (a + ao, a + Q@ +1), there 
are values of x for which f(x) is larger than yo and also values for 
which it is smaller than yo. Divide this interval into 10 equal parts. 
Again in some one of these subintervals, say 


Fie. 20. 


Qi 1 
(a+ co +H a tay +42) 


there must be values of x for which f(z) is greater than yo and others 
for which f(x) is smaller than yo. Dividing this interval into 10 
equal parts, we continue as before. We have in general the interval 


[o(n), ¥(n)], where 


An 
$(n) =a+ar+ it nye. 

An, 1 
Y(n) =ataot i+: as rr Leeyy 


which contains values of z for which f(z) is greater than yp and other 
values for which f(z) is less than yp. As 7 takes all positive integral 
values, the resulting sequence of intervals defines in the limit a 
definite point Xp. 

Because of the continuity of f(x), we have 


LF) = fa). 


However, yo must lie between f [(n)] and f[Y(n)] or coincide with 
one of these values. As 7 becomes infinite x approaches 2 and hence 


L fio} = L fWm)) = L fla) =f). 
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From the equality of the first two of these limits, we have from 
Theorem IV, Art. 24 


L flon)} = L fW)} = we (3) 


By comparison of the results in (2) and (3) we have finally 
Yo = f(%), (4) 


which establishes the theorem. 

In a similar manner we can show that a continuous function takes 
all values between the maximum and the minimum values of the 
function in a given interval; that is, all values between its upper and 
its lower limits. The converse of this statement and of the foregoing 
theorem is not true; that is, it does not follow that a function is 
continuous in an interval (a, 6) because it takes all values between 
f(a) and f(b) or between the upper and the lower limiting values of 
the function in the interval. Thus the function 


f(x) = sin *, x ~ 0, where f(0) = 0, 


oe : : Soe! : 
is discontinuous for z = Osince Z sin - does not exist. Nevertheless, 
z—0 


f(x) takes all values between its maximum and its minimum values 
in any interval inclosing the origin and indeed an infinite number of 
times. 

In fact, there exist functions which take all intermediate values 
between its values at any two points and still are totally discontinu- 
ous in that interval.! 

If we have given a function of two variables f(z, y) the problem 
of continuity presents nothing new so long as we confine our attention 
to continuity with respect to each variable separately. The fore- 
going theorems may be extended to the case of continuity with 
respect to the two variables taken together. To do this one needs 
merely to substitute region for interval in the statement of the the- 
orems and generalize the proof accordingly. 

Continuity of f(z, y) with respect to both variables at a given 
point (%o, yo) implies the continuity at this point of the function 
with respect to x and to y. It does not imply, however, that f(z, y) 


1 For example of such a function see Art. 27. 
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is continuous in each variable separately in the deleted neighborhood 
of this point. For example, let 


f(a, y) = asin +, forz #0, y <0, 
Y 
= 0, 
for z = 0 and all values of y; also for y = 0 and all values of x. This 
function is fully defined in the neighborhood of (0, 0), and is con- 


tinuous in (z, y) at the origin. However, it is not continuous in y 
for z ¥ 0, since the limit 


a! 
L f(x,y) = L asin -; (4 £0), 
: y—0 y—0 y 
does not exist. 

If f(z, y) is known to be merely continuous in z alone and in y 
alone, then questions arise which involve the relations between con- 
tinuity in the two variables and that in each variable separately. 
We shall now consider some of these questions. 


TueoreM VI. Let f(x,y) be defined for the region asaxsb, 


ey Sd, in which it 1s continuous with respect to x and to y. At 
every point (Zo, Yo) of this region, we have 


L L f(z,y) ree Lb IG W) = $0, yo). 


LiLo Yo 
It will be seen that the function as thus defined satisfies the con- 
ditions for the interchange of iterated limits as given in Theorem VI, 
Art. 24; for, from the continuity with respect to x and to y, we have 
condition (a) of that theorem, namely 


L f(x,y) =f(20, y), ¥ F Yo, 
L f(, y) = f(z, Yo), LA XD. 
yy 
Since f(z, y) is continuous in y for all values of z, we have for x = 2 


oe f(Zo, y) = f (Xo, Yo)» 


which is condition (b) of the theorem quoted. We may show as 
follows that condition (c) is also satisfied. Because of the continuity 
in each of the variables, we have 


| f(x, wo) ~ f(z, yo) | <j 12-01 < by (6) 
| $x, Yn) — f(x, wo) | <5 [Yayo] <1, (7) 


[fe Yo) — fy) <5 |e - 01 <5, Ay (8) 
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Combining these inequalities, we have 


| f(a, Yn) — f(a, Yo) | <€, 
which holds for each value of x in the smaller of the two intervals, 
(xo — Sy, to + Sy,), (Go — Oy, Lo + 6,,), and for each value of y, suffi- 
ciently close to yo. It therefore holds for any set {yn} dense at yo. 
Since all three conditions are satisfied, the interchange of the order 
of limits is permissible and the theorem follows. 

It is often necessary to examine the nature of the limiting function 
along the boundary of the region in which the function is defined. 
Suppose, for example, that f(x, y) is continuous in z in the region de- 
fined by the inequalities 


OS Sy ae 
For points on the boundary line y = yp, let the function be defined 
Pigs JE fey) =I w). 


We shall examine the nature of the convergence of f(z, y) to the 
limiting function f(x, yo). As will be seen, this problem is a general- 
ization of the corresponding problem which arises in the convergence 
of an infinite series or of a sequence of functions. 

Let x, be any constant value of x in the interval (a, b). We have 


then ' i f(x, y) = f(%1, Yo), 


which may be expressed as an inequality as follows 


| fl, y) — f@, yo) | < €, |y — yo| < d(x). (9) 
Geometrically, this relation means that for x = x, the values of 
f(%1, y) lie in the rectangle whose sides are given by the equations 

Z=f(X, Yo) +6 Y= Yo Y = Yt (x1), 
as indicated in Fig.21. 
If we keep the value 
x of € fixed while the 
* point x is allowed to 
change, the value of 
eee d(x) may vary with 
x. For example, for 
= 22 the value of 


ry) ay aa ame 
d(a2) may be quite 


Fig. 21. different from 6(z,). 
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Thus, for each value of x in the interval (a, b) there is determined 
for a given € a definite value of 6(x). This aggregate of values of 
6(zx) has a greatest lower bound 6 in the interval (a,b). If 6 is 
different from zero, then f(x, y) is said to converge uniformly to the 
limiting function f a yo). This kind of convergence is quite distinct 
from the convergence of f(x, y) for each value of x in the given 
interval. The latter means that for any value of € there exists a 6(2) 
for each value of 2 in (a, 6), which may, however, change with the 
point x. Uniform convergence, on the other hand, means that for a 
given value of € there exists a value 6 different from zero for which 
the inequality (9) holds uniformly for all values of x in (a, b); that 
is, 6 is independent of z. 
The curves whose equations are obtained from 


@ = f(z, Y), 


by putting y = y,, where y, * yo, are called the approximation curves 
of the limiting function z = f(x, yo). These curves are those cut from 


th f 
e surface ee eet 


by the planes mci 


In the case of uniform convergence, these approximation curves 
become in the limit, as y, approaches yo, the curve z = f(x, yo). The 
approximation curves can be conveniently exhibited by projecting 
them upon the (XZ)-plane. If the given function converges uni- 
formly, then all of the projections of the approximation curves from 
a certain point on must fall within a strip of width € on either side 
of the curve z = f(z, yo). The following example will illustrate a non- 
uniformly convergent function. 


ices SiO <a Sl, acre Oa y Ue 


Ex. 8. Given/f(z, ire ; 
Draw three approximation curves and show that f(x, y) does not converge uni- 


formly to f(z, 0). 
The value of f(z, 0) is zero for all values of x, and hence the curve 


z=f(a, 0) 
is the X-axis itself. For y = yn= *, we have the approximation curves whose 
equation is ae 

was + nx? 


The nature of the approximation curves is indicated in Fig. 22, each curve being 
projected upon the (XZ)-plane. 
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Each approximation curve has a peak of height 3 for some value of x, no matter 
how large n may be taken. As 7 increases the peak in the curve grows sharper 
and approaches the origin, but it 
never disappears, nor does its 
height change. Hence, if we lay 
off a strip of width ¢€ along the 
curve z = f(x, 0), namely along the 
X-axis, the approximation curves 
never fall wholly within it. Con- 
sequently, the given function does 
not converge uniformly to the lim- 
iting function f(x, 0), although the 
given function is everywhere con- 
Bre. 22. tinuous in x and in y. 


As acriterion for uniform convergence of f(x, y) to the limiting 
function f(z, yo), we have the following theorem. 


TueoremM VII. Let f(x, y) be continuous in x fory ~y,aSxszb, 
and defined for y = yo by the limit L f(a, y) =f(x, yo). A necessary 
y—Yo 


and sufficient condition that f(x, y) converges uniformly to the limiting 
function f(x, yo) is that the simultanzous limit L f(x, y) exists at each 


xr—X 


point xo of the closed interval (a, b). Sy 


The condition of the theorem is necessary. For, let us assume 
that f(x, y) converges uniformly, and let x be any point of (a, 6). 
From the definition of f(x, yo), we have for a sufficiently small 6 


| f(xo, y) — f(x, yo) | < €, |y — yo| = 4. (10) 


Because of the continuity of f(z, y) in x, we have on the line 
y =yo+ 6 an interval (x — 7, 2 +7), where 7 is a function of 6, 


Fie. 23. 


such that we have for all values of x in this interval 
| f(x, yo + 4) — f(o, Yo + 4) | < €. 
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By virtue of the uniform convergence of f(x, y) we can select a 6 
independent of xo so that we have for all values of x in (29 — , 20 + n) 
| f(a, y) — f(a, yo + 8) | <e. 

The inequality (10) holds for y = yo + 6, and hence we may write 


| f(Zo; yo + 6) — f(x, yo) | <€. 
Combining these three inequalities, we obtain 
| Fy) — Fo, yo) | < 36, |y-— yo] <6, |t@-—x| <n; (11) 
that is, for a given ¢ there exists a region defined by the equation 
Y = Yo, y=Yyt 6, ct=% + 1, 
such that for any point (2, y) in this region the value of f(z, y) 
differs from f(x, yo) by less than 3¢. Hence, we have 
os F(@, y) = f(Xo, Yo). 
yu 
As 2 was any point in the closed interval (a, b), it follows that this 
limit exists at all points of the given interval. 


The given conditions are also sufficient. For, we then have about 
each point (20, yo) of the closed interval (a, 6) a region defined by the 


inequalities kage [eh lan a 
such that for each point (2, y) in this region we have 
| f(z, y) ae f(2o, Yo) | < €, (12) 


where € is arbitrarily chosen. It is to be understood that if x is an 
extreme point of the given interval (a, b), then only that portion of 
the above region is to be considered which corresponds to values of 
x in (a,b). Keeping e fixed when once chosen, the value of 6 depends 
upon the choice of zp and to each value of z in the closed interval 
(a, b) there is defined a definite value 6(x). The aggregate of these 
values has a greatest lower bound 6). 

This greatest lower bound 6, is different from zero. For, assuming 
that it is zero there must be some point 2’ of the closed interval (a, b) 
in every neighborhood of which the greatest lower bound is zero. For 
xz = x’, however, the value of 6 must be different from zero, since the 
inequality (12) must hold for 4 = 2’, y = yo. Put d(x’) = 6’. Then 


/ / 


in the interval i: — S xv’ + 5) the value of 6(x) for each point is 


, 
at least equal tos: But, as 6’ is different from zero, the greatest 
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lower bound of 6(z) in this subinterval must be different from zero, 
which is contrary to our assumption. From this contradiction it fol- 
lows that the conditions of the theorem are sufficient. 
Another condition which is often convenient in testing the uniform 
convergence of a function is that given by the following theorem. 
TuroreM VIII. Lf, in the closed interval (a, b), f(x, yo) 1s defined by 


Gaga L f(x,y) = f(x, y); (a) 


yo 
and if for all values of y ¥ yo and all values of x in (a, b) we have 
| fe(z, y) | < M, (0) 
where M is a finite number, then f(x, y) converges uniformly to the 
limiting function f(x, Yo). 
Any plane parallel to the (XZ)-plane cuts from the surface 
z= f(x, y) 


a curve. Let (x) be the angle which the tangent to this curve 
makes with the orthogonal projection of this tangent upon the 
(X Y)-plane. Then from condition (6) of the theorem, we have 


lfe@, y)| =|tang(z)|<M 


for all values of x in (a, b) and all values of y different from yo. For 
a given value of ¢€ there then exists about any point 2 of (a, b) an 
interval (a — 6, x) + 6) within which we have 


Lf@, y) — f (xo, y) | < €, 


where y may have any value different from yo. 
From condition (a) of the theorem, we have 


| f(xo, y) — f(x, yo) |< €, ly -—yol <m. 
Combining these inequalities, we obtain 
| f(z, Y) — F(x, yo) | < 2€, |x — | < 6, |y-y| <7, 
which is the condition that 
L_f(@, ¥) = fle, ws) 
yo 


for any point 2 of the closed interval (a,b). By Theorem VII it 
follows that f(x, y) converges uniformly to the function f(z, yo). 
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Ex. 9. As y approaches 0, test the uniform convergence of the function 


f@, y) =aretanzy, OS e51,0<ySl, 


where f(z,0) = ZL arc tan zy = 0. 
yo 
Differentiating, we have 
r ar Ue, 
FAS, y) a 1 + xy? 


For0 $z<1,0 <y <1, we have 
y 
, Fy een Anes 
| @, W 1 =| pawl <1. 


Hence, by the foregoing theorem the given function converges uniformly to the 
limiting function. 

While this theorem gives us a convenient test for the uniform 
convergence of a function, it does not give a test for the non- 
uniform convergence of a function; for, it is a sufficient but not a 
necessary test, as the following exercise shows. 


Ex. 10. Test for uniform convergence the function 
fz, y) =vVay, OX 251, 0<ySl, 
where f(z, 0) of Lvuy = 0. 
We have for z #0, y 0 


f(z, v) =5 \/ 4, 


which has no finite upper bound in the neighborhood of x =0, y 0. The condi- 
tions of the foregoing theorem are not satisfied. However, the function converges 


uniformly; for, % 
L f(z, y) = L Vay =0 = f(x, 0) 
0. ery 
for every value of 2 in the closed interval (0,1); that is, the conditions of The- 
orem VII, which are both necessary and sufficient for uniform convergence, are 
satisfied. 
A useful criterion for continuity of the limiting function f(z, yo) is 


given by the following theorem. 


TuroreM IX. Let f(x, y) be continuous in x for y ¥ yo and let rt 
converge uniformly to the limiting function f(x, yo) in the interval (a, b). 
Then f(x, Yo) 1s continuous in x. 


Let x be any point in (a,b). Since f(z, y) converges uniformly 
to the function f(z, yo), we have by Theorem VII 


L f(z, y) = f (Xo, Yo). 


zZ—2X 
y—yo 
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Moreover, as f(z, y) is continuous in x for y # yo, we have 
L f(x,y) = f(®o, y)- 
xL—I 


From the definition of f(a, yo) we have 
L f (Xo, y) = S (Xo, Yo)s 
yVo 


or combining these results, we may write 
L L f(x,y) =f(xo, yo). 
yYo IT 
The conditions of Theorem V, Art. 24 are satisfied and hence we 
may interchange the order of limits and write 
L L f(,y) = L f(a, yo) =f(%o, yo). 
x“—Xo YYo IX 
From this last equality it follows that f(a, yo) is continuous at 2. 
As 2p is any point of the closed interval (a, 6) it follows that f(x, yo) 
is continuous throughout the interval. 

That the foregoing condition is sufficient but not necessary for the 
continuity of f(x, yo) is at once apparent. For example, the function 
given in Ex. 8 converges to a continuous function of x, but the con- 
vergence is non-uniform. : 

A necessary and sufficient condition that f(x, yo) is continuous at 
any point 2 of the given interval may be stated as follows.! 


TurorEM X. Let f(x,y) be continuous in x for y ¥ Yo, and tet 
f(x, yo) = L f(x,y) for each value of x in a closed interval (a, b). 
y¥~Yo 


A necessary and sufficient condition that f(x, yo) ts continuous in x at 
X=%, a5 % Sb, rs that for an arbitrarily small positive € and for a 
set of values {yn} dense at yo, there exists an interval (ao — 5y,, Zo + 5y,,), 
whose length is different from zero and may vary with yn, such that for 
all values of x in this interval we have 


| f(z, Yn) — f(x, Yo) | <n GC: 


This theorem follows at once from the condition given in The- 
orem VI of Art. 24 for the interchange of the order of limits. We 
have given the condition that 


LL f@,y)= ny F (0, ¥) = F(%o, Yo). 


Y>Yo LX 


1 See Arzela, Sulle serie di Funzioni (1899) Parti Prima, p. 14. 
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By the interchange of limits this relation gives 
L L f(x, y) > me F(z, Yo) i f (Xo, Yo); 


tI Y-Yo 


and hence f(z, yo) is continuous at x = 2. 

The foregoing theorem gives a necessary and sufficient condition 
that f(x, yo) is continuous at a single point. We may generalize this 
result so as to get a condition for the continuity of f(z, yo) through- 
out an interval by introducing what we shall call quasi-uniform con- 
vergence,' which may be defined as follows. 

As in the foregoing discussion, let f(x, yo) be defined by the relation 


ale f(x, y) oy f(x, Yo) 


for each value of z in the closed interval (a, 6). The function f(z, y) 
is said to converge quasi-uniformly to the limiting function f(z, yo) in 
the interval (a, b), if for an arbitrarily small positive number € and 
for some yn * Yo, there exists a positive number 6 and a finite set 
of values of y, say 


Yi, Yo, Y3, °° * * » Yk» ° * * 5 Yn-t, 
lying between yp and the given value y, such that on the lines 
Y= Yn k=1,2,:- -,n—1, 


it is possible to choose a 
finite number of segments, 
each of length at least equal 
to 6 such that the sum of 
their projections on y = Yo 
completely covers the inter- 
val (a, 6) and furthermore 
for all values of z in this 
interval we have 


| f(x, yo) — f(z, yx) |<€, (13) Fic. 24. 

the point (z, y,) being a point on some one of these segments. 
Quasi-uniform convergence differs from ordinary uniform con- 

vergence in that in the latter case the condition (13) must hold not 


1 Called by Arzela “ uniform convergence by segments.” The term ‘“quasi- 
uniform convergence ” is due to Borel. See Encyclop. des sci. math. U2, Art. 52. 
Quasi-uniform convergence is the more descriptive term, since there are functions 
satisfying the Arzela conditions for convergence which do not converge uniformly 
in any subinterval. 
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only for all values of x but for all values of y in the neighborhood of 
yo Ufa given function converges uniformly to its limiting function, 
it also converges quasi-uniformly. The converse, however, is not 
true. 

If the given function f(z, y) satisfies the foregoing conditions for 
quasi-uniform convergence except for a finite set of subintervals, the 
sum of whose lengths is arbitrarily small, then we say that f(z, y) 
converges to the limiting function f(x, yo) quasi-uniformly in general, 
or quasi-uniformly almost everywhere. 

We may now state the following theorem. 


TuroreM XI. If for y ¥ yo the function f(x, y) ts continuous in 
x in the closed interval (a, b), a necessary and sufficient condition that 
the limiting function f(x, yo) also is a continuous function of x in (a, 6) 
is that f(x, y) converges quasi-uniformly to f(x, yo) in this interval. 


From the continuity in z of f(x, y) for y ¥ yo and from the defini- 
tion of the limiting function, it follows that 
L L f(z, y) - Be lm y) i: f (Xo, Yo)s (14) 


Y¥Y>Y¥o LIX 


where 2 is any point in the ae interval (a, 6). Because f(z, y) 
converges quasi-uniformly to the limiting function f(z, yo), the con- 
ditions for the interchange of the order of iterated limits given in 
Theorem VI, Art. 24 are satisfied for any point 2% of (a, 6). Hence 
we have from (14) 

ie f(z, y) = ib f(x, Yo) = f(Xo, Yo). 


ZX Y—yYo 


Since x is any point in (a, b) it follows from the existence of this 
last limit that f(x, yo) is a continuous function of 2 in the closed 
interval (a, 6). 

In quasi-uniform convergence, an essential condition is that there 
shall exist a set of values {y,} dense at yo. In the foregoing discus- 
sion, we have assumed that f(z, yn) is continuous in x. If we replace 
the sequence {yn} by the sequence {n} of positive integers, where n 
may be regarded as a subscript, the foregoing theorems give at once 
important results concerning the continuity of the limiting function 
f(x) of a sequence {f,(x)} of continuous functions. For example, 
Theorem X gives a necessary and sufficient condition that f(x) is 
continuous at a given point x. It follows from the theorems on 
uniform convergence that, if the sequence of continuous functions 
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converges uniformly in the interval (a, b), then f(z) is continuous 
throughout that interval. The condition of uniform convergence, 
however, is sufficient but not necessary for continuity. Both a 
necessary and sufficient condition for the continuity of f(x) is given 
by quasi-uniform convergence of the given sequence {f,(x)}. As we 
shall see later, these conclusions apply also to the character of a func- 
tion defined by a convergent infinite series, since its convergence may 
be made to depend upon the convergence of an infinite sequence. 
27. Semi-continuous functions. As we have seen, the maximum 
value of f(x) at a point 2, namely M(f, 20), is the largest of the three 
numbers f(%o), f(vo + 0), f(@o — 0). Let us now suppose that 


(xo) = M(f, a0). 


If, for an arbitrarily small positive e, there exists a 6 > 0, such that 
for all values of x in the neighborhood (xp — 6, x) + 6) we have 


F(x) < fo) + «, (1) 


then f(x) is said to be upper semi-continuous at x, or Xp is a point 
of upper semi-continuity of f(x). 
Similarly, if we have f(xo) = m(f, 2), 


where m(f, 2) is the minimum value of f(x) at x, then we say that 
f(x) is lower semi-continuous at 2%, if there exists a neighborhood 
(ao — 6, 2 + 6) such that for all values of x in this interval 


f(x) > f(%o) — €. (2) 

One may also characterize semi-continuous functions by their 

relation to continuous functions. In order that f(x) shall be con- 
* tinuous at zo, one must have 


| f@) - f(a) |<, [2-20] < 6, 
which is equivalent to the two conditions 

f(z) < f (20) + €, | x =a Xo | < 6, 

f(x) > f(x) Gs |“ — 2o| < é. 
Upper semi-continuity implies that the first of these conditions holds, 
while the second may not hold, and also that f(a) is the maximum 
value of f(x) at the point. A similar statement may be made con- 
cerning lower semi-continuity at 2. 

A function is upper semi-continuous throughout an interval if 

each point of the interval is a point of upper semi-continuity. Simi- 
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larly, a function is lower semi-continuous in an interval provided 
each point of the interval is a point of lower semi-continuity. If a 
function is both upper semi-continuous and lower semi-continuous, 
it is continuous, and conversely if it is continuous it has both of 
these properties. 

As an illustration of an upper semi-continuous function, we have 
the function M(f,x) discussed in Art. 25. Similarly the function 
m(f,x) is an illustration of a lower semi-continuous function. 

As another illustration of an upper semi-continuous function, we 
may consider the values of 6 defined in connection with continuous 
functions. From the continuity of a function f(x), we have for any 
2 in a given interval (a, d), 


| f(a) — f(xo) | < 1, [2 —2%| <9, (3) 


where 7 is arbitrarily small and 6 depends upon 7 and upon the 
choice of x. For any given 7 there is defined a 6(x) for each x in 
the given interval (a,b). It is this function 6() that we shall con- 
sider, it being assumed that 6(z) is always taken as large as possible 
to satisfy the conditions given in (8). If f(x) is constant in (a, b), 


a Ah @ a b” oR B! b 
a ee 
Zs 
Pies 25: 


it follows at once that d(x) is upper semi-continuous; for, it is the 
distance from 2% to the nearest extremity of the interval (a, b) and 
in fact in this case 6(x) varies continuously with z. 

We shall now consider the case where f(x) is not a constant in 
the neighborhood of a. Let A, B be the extremities of the interval 
{to — 6(%), Xo + O(xo)}. For a proper choice of 7 we can select 
some value 2; in the neighborhood of xp but distinct from it, such that 
one extremity of the corresponding interval [a — 6(a), a1 + 6(a1)] 
will fall outside of AB, while the other extremity may lie within AB. 
This statement is true irrespective of the side of 2 on which 2; is 
situated, due to the fact that f(x) is continuous and the value of 6(z) 
is always chosen as large as possible. Allow x to range over such 
values in the neighborhood of x that the extremities of the corre- 
sponding interval {x — 6(x), x + 6(x)} satisfy the foregoing condition 
that at least one falls exterior to AB and the other lies on the op- 
posite side of 2. Denote the interval within which the extremities 
of the 6(x) interval may lie by A’, B’. By choosing the points A’ 
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and B’ arbitrarily, one restricts the range within which x, must lie. 
For example, we may put 


A’ = 2% — 6@%) —€, B’ =% + d(m) +6, 


where € is arbitrarily small. Denote by (a’b’) the corresponding 
neighborhood of x) over which x; may range and neither extremity 
of the interval [a — (a), 21 + 6(a)] lie exterior to A’B’. Then 
for all values of x within (a’b’), we have 
(x) < (a) + €; 

that is, 6(x) satisfies the definition for an upper semi-continuous 
function at the point x. But as x is any point in the given interval 
(a, b), it follows that 6(x) is upper semi-continuous throughout the 
interval. In case f(x) is uniformly continuous in (a, b) it follows that 
the upper semi-continuous function 6(x) has a positive lower bound. 
If, on the other hand, f(x) is continuous but not uniformly so, then 
6(x) has zero as its greatest lower bound. 


THEOREM I. Given a finite number of functions which have a com- 
mon point of upper semi-continuity, then their sum is also upper 
semi-continuous at that point. 


It is sufficient to prove the theorem for the sum of two upper 
semi-continuous functions. The same method applies to the sum of 
any finite number of such functions. A similar theorem may be 
established for lower semi-continuous functions. 

Let the two given functions be ¢,(x) and ¢2(x), and let x» be a 
point at which both are upper semi-continuous. We then have for 
all values of x in some interval (2) — 6;, 2 + 6,) the relation 


gila) < dile) + 5 
Similarly, there exists an interval (x — 62, % + 62) such that for all 
values of x within it, we have 

dala) < aa) + 5° 
Combining these two inequalities, we have 


gi(x) + o(x) < dil%o) + b2(20) + 6, 


which holds for all values of x within (a) — 6, 2 + 6), where this 
interval is the smaller of the two intervals 


(Xo — 61, Xo + 61), (%o — 62, Xo + 9:2). 
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Hence, the sum of the given functions is upper semi-continuous, as 
the theorem requires. 


TueorEM II. Jf f(x) ts an upper semi-continuous function at 
x = 2 then — f(z) is a lower semi-continuous function at that point. 


Because f(x) is upper semi-continuous at any point 2, we have 
f(z) < f(z) +€, m—8<4< m+. 
Changing the signs of each member of this inequality, we have 
— f(z) > — f(a) — €; 

that is, — f(z) is a lower semi-continuous function at 2. 

Similarly, it may be shown that if f(x) is a lower semi-continuous 
function at 2, then — f(x) is an upper semi-continuous function at 
the same point. 


TueoreM III. The saltus function w(f,x) ts an upper semi- 
continuous function. 

The saltus function was defined by the relation 

w(f, z) = M(f, x) a mf, z), 
where M(f, x) denotes the maximum value and m/(f, x), the minimum 
value of f(x) at each point z of a given interval. As we have seen, 
M(f, x) is an upper semi-continuous function. By Theorem II it 
follows that — m{f, x) is an upper semi-continuous function. The 
function w(f, z) can then be written as the sum of two upper semi- 
continuous functions as follows 
w(f, x) ae M(f, z) + {- m(f, x)}. 

It is therefore an upper semi-continuous function, as the theorem 
states. 

In a similar manner, it may be shown that the saltus function of 


a function of two independent variables is also an upper semi-con- 
tinuous function. 


TueoreM IV. If f(x) is an upper semi-continuous function in 
the interval (a, b), then the points of (a, b) where 


f(z) 2 A, 
A being any arbitrarily chosen number, form a closed set. 


Let 2 be a limiting point of a sequence {z,} at each point of 
which we have flee) = A. 
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In every neighborhood (zp — 6, x) + 6) of z» the least upper bound 
M(f, 6) of f(z) for all values of z is at least equal to the least upper 
bound of f(z,). As 6 approaches zero, the limit of M(f, 6) is the 
maximum value of f(z) at the point z. Hence, we have 


M(f, x) 2 A; (4) 


for, as x takes the values of the set {z,}, the corresponding values of 
f(z) are all equal to or greater than A. As f(z) is an upper semi- 
continuous function at zo, then 


M(f, 20) = f(2o), 


whence from (-) f(a) 2 A. 


In a similar manner it can be shown that the points at which a 
lower semi-continuous function is less than a given number form by 
themselves a closed set. 

The foregoing theorem can be extended to functions of two or more 
variables. The proofs are similar, the functions w(f, z), M(f, z), 
m(f, x) being replaced respectively by the corresponding functions 
for f(x, y), namely w(f, z, y), M(f, x, y), m(f, x, y). 

28. Discontinuous functions. In this article we shall consider 
particularly those functions having an infinite number of points of 
discontinuity. Such functions are totally discontinuous if every 
point is a point of discontinuity or they may be point-wise discon- 
tinuous if the points of continuity form a set everywhere dense. 
Theorem III of the last article states that the saltus function is upper 
semi-continuous and by Theorem IV of the same article the points 
where such a function exceeds an arbitrarily chosen number form a 
closed set. This leads to the conclusion that the set of discontinu- 
ities where the amount of the discontinuity exceeds an arbitrarily 
chosen number is necessarily closed. If these points are everywhere 
dense in any interval, then every point is such a point. Conse- 
quently, totally discontinuous functions are further characterized by 
the condition that the points where the saltus is greater than an 
arbitrarily selected A form a set everywhere dense. 


Turorem I. A semi-continuous function is at most point-wise 
discontinuous. 


Let f(z) be any function defined for the interval (a, b), and for 
convenience let F(z) on M(f, x) — f(z). (1) 
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Consequently, F(a) is either positive or zero at each point of (a, 6). 
The function M(f,'‘x) is upper semi-continuous in the same interval. 
Denote by (a’, 6’) any subinterval of (a, 6), and let x be any point of 
(a’, b’). Because M(f, x) is upper semi-continuous at xo, we have for 
all values of x in the neighborhood of xo 


M(f,x) < M(f, to) + €. (2) 


Since M (f, x) is also the maximum value of f(x) at 2, it follows that 
in every neighborhood of x a point x; can be found for which 


f(a) > Mf, %) — €. (3) 


The inequality (2) holds for all values of x in every neighborhood of 
xo and hence for x = 2;. We have then from (2) and (3) 


M(f, x1) — fla) < 2e. 


As € is an arbitrarily small number, it follows that 2 is a point at 
which F(x) takes the value zero. As 2 is a point in (a’, 6’) and in 
every neighborhood of each such point there exists a point 2, it 
follows that the points at which F(a) has the value zero are every- 
where dense in (a, b). 

Similarly, it may be shown that the points at which 


f(x) — m(f, 2) 

has the value zero form likewise a set everywhere dense in fa, 6). 

Let now f(x) be an upper semi-continuous function; then we have 

ers f(z) = M(f, 2). 
The saltus function is 
w(f, x) = M(f, x) — m(f, x) = f(x) — m(f, 2). (4) 

But, as we have seen, the points are everywhere dense in (a, b) where 
f(x) and m(f,x) are identical. It follows from (4) that at these 
points the saltus function is zero and hence f(x) is continuous. Con- 
sequently, every upper semi-continuous function is at most point- 
wise discontinuous. 

Similarly, one may show that every lower semi-continuous function 
is at most point-wise discontinuous. Hence, the theorem follows. 

The foregoing theorem can be extended to functions of two or more 


variables. The proof is similar in that the interval is in that case 
replaced by a region. 


TuEorEM II. The points at which f(x) has a discontinuity equal 
éo or greater than a given number A form a closed set. 
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This theorem follows at once as a consequence of Theorem IV 
of the last article. For, as we have seen, the saltus function w(f, x) 
is an upper semi-continuous function and by the theorem quoted 
the points at which such a function has values greater than A form 
a closed set. 

It follows from the foregoing theorem that, if f(x) has a discon- 
tinuity greater than A at a set of points dense at some point, then 
that point itself is a point of discontinuity where the amount of 
discontinuity is equal to or greater than A. 


TueEoreEM III. A necessary and sufficient condition that a function 
f(x) is point-wise discontinuous in a given interval (a,b) is that the 
points at which the saltus exceeds an arbitrarily chosen number A do 
not form a set everywhere dense in any subinterval of (a, b). 


The condition is necessary; for, by Theorem II, the points in 
question form a closed set and, if they are also everywhere dense in 
any interval, then in that subinterval every point is a point of dis- 
continuity and f(z) can not be point-wise discontinuous. 

The condition stated in the theorem is also sufficient. To show 
this, we consider any sequence of numbers 


ih 2 YP 2 Be 2 2 9 Si So 
such that n=; 


no 


By the conditions of the theorem the set of points at which the dis- 
continuity is equal to or greater than 7; can not be everywhere 
dense in any subinterval (a, 6;) of (a, 6). There must then be some 
portion of (a, 6:) which is free from such points. Let (dz, be) be 
such a subinterval of (a, 6). Likewise, the points where the dis- 
continuity is equal to or greater than 72 can not be everywhere 
dense in (de, b2) and there must be a subinterval (as, bs) of it which 
is free of such points. In the same way we can find a subinterval 
(a4, bs) of (a3, 63) which is free of points where the discontinuity is 
greater than 73, etc. In general we find in this manner a subinterval 
(an, bn) free from points where the discontinuity is greater than n-1. 
If the process is continued indefinitely, we thus obtain a sequence of 


intervals (4, b,), (de, bs), (as, bs), ~~ ° y (Any bn), °° 


each lying within the previous interval. If we now impose the 
further condition that — _, (agj=ib.) 2x0 
nh n ) 


no 
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this sequence of intervals defines a definite point 2. At this point 
the discontinuity of f(x) can not exceed the limit of 7, as n becomes 
infinite, and as the amount of the discontinuity, that is the saltus, 
is never negative it must be zero. In other words, 2 is a point of 
continuity of f(z). As (a, b:) was any subinterval of (a, 6), it follows 
that under the conditions of the theorem the given function must 
have at least one point of continuity in every subinterval and is 
therefore at most point-wise discontinuous. 

It follows that the most general set of points that we can hae 
where the discontinuity of a point-wise discont nuous function ex- 
ceeds a given number A is a perfect set which is in no subinterval 
everywhere dense, or such a set plus a set which is in no part of 
(a, 5) everywhere dense. It is not to be understood that the set of 
all points of discontinuity of a point-wise discontinuous function 
may not be everywhere dense in the interval of definition. Indeed 
such may be the case, as we shall see later, provided the saltus func- 
tion has the lower limit zero at a set of points which is everywhere 
dense. 

It follows as a consequence of this theorem that the sum or prod- 
uct of any finite number of point-wise discontinuous functions can 
not be totally discontinuous; for, the points where the discontinuity 
exceeds A in the sum or product can not exceed the sum of the sets 
of points where the individual functions have a discontinuity greater 
than A, and this sum can not be everywhere dense. 


THEOREM IV. The points of continuity of a point-wise discontinu- 
ous function form a set having the cardinal number of the continuum. 


As in the proof of Theorem ITI, let 


> sh a ee 
be a sequence of numbers such that 
L a= 0. 


Let E, be the set of points where the saltus of f(x) is equal to or 
greater than 7;, Zs, the set of points where it is equal to or greater 
than 7, etc., E, being that set of points where f(z) has a saltus 
equal to or greater than y,. Each set in the sequence of sets 

R,, Bs bee 


is in no portion of the given interval (a, b) everywhere dense. From 
the definition of a set of points of the first category, it follows that 
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the sum of the sequence {£,,} is a set # of the first category; more- 
over, it is the set of all of the points of discontinuity of viaje “the 
complementary set C(Z) is the set composed of all the points of con- 
tinuity of f(z). As ZH is of the first category C(#) must be of the 
second category. By Theorem V of Art. 18, C(Z), that is the set 
composed of the points of continuity of f(x), must therefore have 
the cardinal number of the continuum. 

It is a consequence of this theorem that a point-wise discontinu- 
ous function can not be discontinuous at the irrational points; for, 
the complementary set, namely, the set of all rational numbers of 
the given interval, could not serve as the points of continuity of 
such a function since the set of rational points is enumerable and 
hence can not have the cardinal number of the continuum. In fact 
it is impossible to have a function which is discontinuous at the ir- 
rational points and continuous at the rational points. For, in that 
case the points of continuity would be everywhere dense in the given 
interval and the function would be at most point-wise discontinuous 
but, as we have just seen, such a function must be continuous at a set 
of points having the cardinal number of the continuum. In fact it 
has been shown that in an interval in which a function f(z) is point- 
wise discontinuous there does not exist another function which is 
continuous where f(z) is discontinuous and conversely.! 

Point-wise discontinuity and total discontinuity describe proper- 
ties of a function with reference to its behavior with respect to an 
interval or at least to a set of points which is dense in itself. The 
characteristic property which distinguishes the one class of functions 
from the other is the distribution in the given interval of the set of 
points where the saltus of the function is equal to or greater than an 
arbitrarily chosen number A. If this set is not everywhere dense 
in any portion of the given interval the function is point-wise dis- 
continuous; if it is everywhere dense throughout the interval, it is 
totally discontinuous.’ 

There are discontinuous functions which in a given interval are 
neither point-wise discontinuous nor totally discontinuous, as we have 
defined these terms. For example, in the interval (— 1, 1) let 


1 See Volterra, Giorn. di mat. Vol. 19, p. 76. 

2 Totally discontinuous functions are sometimes defined as those discontinu- 
ous functions which are not point-wise discontinuous. See Baire, Legons sur les 
fonctions discontinues, p. 75; Caratheodory, Vorlesungen tiber Reelle Funktionen, 


p. 148. 
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f(x) = 2*, for irrational values of z, 
= 0, for rational values of z. 


This function is discontinuous at every point except x = 0. In the 
given interval, f(x) is then neither point-wise discontinuous nor totally 
discontinuous. 

Instead of being continuous at a single point, a non-point-wise 
discontinuous function f(z) may be continuous at a set of points, 
but this set of points can not be everywhere dense in a given interval. 
The points of discontinuity of such a function must be everywhere 
dense in the given interval but they can not form a closed set. A 
function having these two properties may be called a point-wise 
continuous function, in distinction from a point-wise discontinuous 
function on the one hand and from a totally discontinuous function 
on the other. It may be shown that the points of continuity form 
an inner limiting set;! that is, a set of points such that each is an 
inner point of at least one interval of every set of intervals selected 
from a given sequence of sets of intervals. The points of continuity 
of a point-wise continuous function may be enumerable or may even 
form a perfect set and hence have the cardinal number of the con- 
tinuum. For, as we have seen (Art. 17), it is possible to have a per- 
fect set which is in no subinterval everywhere dense. 

The following theorem often gives a convenient test for a totally 
discontinuous function. 


TurorEM V. A function which is defined for a given interval (a, b) 
and takes the same two distinct values in every arbitrarily small sub- 
interval is totally discontinuous in (a, 6). 


Denote by A and B the two constant values which f(x) takes in 
every arbitrarily small subinterval of (a, 6). If ao is any point of 
(a, b) then there must exist in the neighborhood of x a set of points 
{2} dense at zo such that as z is allowed to approach 2» through this 
set we have Layee 
There must likewise exist an .nfinite set {v4} of points dense at 2» 
at which f(x) takes the value B, and hence we may write 


L f(&m) = B. 
Ln—>Zy 


1 See Young, Sitzgsb, Akad. Wien Vol. 112 (1903) Part 2a, p. 1307; also Schoen- 
flies, zbid. (1904), Part 2a, p. 1277. For definition of an inner limiting set and its 
properties see Young’s Theory of Sets of Points, p. 63, et seq. 
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But as A is different from B it follows that the limit L f(x) does 


not exist, and hence f(x) is discontinuous at 2%. Since 2» is any point 
of (a, 6) it follows that f(x) is totally discontinuous in the given 
interval. 

In Art. 26 it was pointed out that a function might take all values 
between any two of its values and still be totally discontinuous. The 
following example furnishes an illustration of such a function. 


Ex.1 1. Show that f(x), defined as follows for the interval (0, 1), takes all 
values intermediate between any two of its values and yet is totally discontinu- 
ous. The variable z is expressed as a decimal fraction, 


= m2 Xo yee gt 
~ 70" 10? 108 © 


If the digits in the odd places, namely 2, x3, z+ + -, form a non-periodic 
sequence, let f(x) be zero. If these digits do form a periodic sequence from some 
point on, say after r2,_1, let f(x) be defined by the relation 


t= 0.2 1222%3 co 8 


= Eaeenee Ton+4 
Ne 10? * 103 


+:- s+. 


The function f(x) is fully defined for all values of x in the interval (0, 1), since 
for each value of zx there is a definite value of f(x). Let (a, b) be any arbitrarily 
small subinterval of (0,1). We shall sY, 
show that f(x) takes all the values rr 
between zero and one as £ varies 
from a to 6. It will then follow that 
f(z) is totally discontinuous in (0, 1) 
by the foregoing theorem; for, since 
it takes all values between zero and 
one, it can be said to take any two 
of these values in every such sub- 
interval. 

Let yo be any point on the Y-axis in the interval (0,1). We shall show that 
we can determine a point 2 in the subinterval (a, b) for which 


Yo 


x 


Yo = f (0). 
Since yo is between zero and one, we may write 
Wins O.titot3 fe 
The values of x may be written 
1 x3 2X5 ae Lon—1 oe 
= 759+ jos + Jost toma & (5) 
vA Lan . . . 
+68 t Toit T08 + Jom + 


1 See Lebesgue, Lecons sur l’intégration, p. 90. 
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If f(x) is to be different from zero the numerators in the first row must, from 
some point on, become periodic. Let 22n-1 be the last numerator before the 
periodicity begins. Suppose a point 2’ of (a, b) is given by taking the first 2n—1 
terms of the fraction; that is, let 


Tan—1 


102"-4 


mee a Es 5. 
t= To gr + 


Whatever digits be chosen as numerators following 22n-1, the value of x can differ 


from 2’ by at most By the proper choice of m we can make 


1 
{O21 


and hence the value of z lies within (a,b). In (5) we shall now replace those 
numerators following x2n_1 having even subscripts by the digits used in defining 
yo; that is, we shall define 2 as follows: 


X= 0.2122 St Von tiLon41 b2Lon+3 ts eta eg 


The point x is then a point of the subinterval (a,b) and f(xo) is the value yo. 
But yo is any point on the Y-axis between zero and one, and hence f(z) must take 
all values between zero and one as x is given the values of the arbitrarily small 
subinterval (a,b). By Theorem V, f(x) must then be totally discontinuous in 
the interval (0, 1). 


This example gives an illustration of the type of functions, men- 
tioned in Art. 26, which may take all intermediate values between 
any two of its values and still be totally discontinuous. For, since 
f(x) takes all values between zero and one and can have no values 
greater than one, it must take in every subinterval all intermediate 
values between its values at the extremities of that subinterval. 


TueroreM VI. The points of a given interval (a, b) at which f(x) has 
ordinary discontinuities form at most an enumerable set. 


Denote by LE, the set of points in (a, 6) at which f(x) has a dis- 
continuity of the first kind such that the saltus is greater than 7. 
We shall first show that H, is an isolated set and hence by the corol- 
lary to Theorem IV, Art. 15 is enumerable. If EH, is a finite set, it 
follows at once that it is enumerable. If H, is an infinite set, it 
must then have at least one limiting point. Let xo be such a point. 
In every neighborhood of x there must be an infinite number of 
pairs of points dense at x such that the difference of the functional 
values is greater than 7. Moreover, these pairs of points can be so 
chosen as to lie on the same side of a. For example, suppose these 
points lie to the right of x; hence, the right-hand limit L f(z) 


Lo + 
can not exist. It follows from the definition of an ordinary discon- 
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tinuity that x) can not be a point of discontinuity of this type and 

hence can not be a point of H,. But x was any limiting point of £,, 

and consequently £, can not contain its limiting points and nee 

therefore, be an isolated set. It is therefore an enumerable set. 
Assign to 7 a sequence of positive values 


Tige ey ee nye 8! 8, 
where Lm, = 0. 


The corresponding set of points Hy, is enumerable for each value of 
n. The totality of points of ordinary discontinuity of f(x) in (a, b) 
is then the sum of the sequence of enumerable point sets 

Fig Ug ri eee 
and hence by Theorem I of Art. 15 must be enumerable. 

If we have given a function f(z, y) of two variables which is con- 
tinuous in each variable separately, it is possible for it to have a 
discontinuity with respect to the two variables taken together. For 
example, we have seen that the function 


cd i z=0, y=0 
is continuous in x and in y but has an (2, y)-discontinuity at the origin. 
It is continuous in the two variables elsewhere. 

We shall now consider the question as to whether such a function 
can be totally discontinuous in x and y together and still be continu- 
ous in each variable separately. As an auxiliary theorem in answer- 
ing this question we have the generalization of Theorem II which for 
the case of two variables may be stated as follows. 

TueoreM VII. If f(x, y) ts continuous in each variable separately 
the points at which it can have a discontinuity in the two variables 
together, where the saltus is equal to or greater than a given number A, 
form a closed set. 

The proof differs from that of Theorem II only in that one makes 
use of the generalized form for two variables of Theorem IV, Art. 27, 
and it can be readily supplied by the reader. By aid of this theorem 
we can now establish the following theorem. 

TueroreEM VIII. [If f(z, y) is continuous in each variable separately, 
the set of points at which f(x, y) has an (xy)-discontinuity where the 
saltus is equal to or greater than an arbitrarily chosen number A can 
be in no subregion everywhere dense. 
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Let E be the set of points where the (xy)-saltus of f(z, y) is equal 
to or greater than A. We shall prove the theorem by assuming 
that E is everywhere dense and showing that this assumption leads 
to a contradiction of the hypothesis that f(z, y) is continuous in 
zandiny. For example, let the points of E be everywhere dense 


Zh 


we ay 0 ae 


C 


in the region bounded by the lines 
G=464,2=6, y=64 9=—2 
From Theorem VII it follows that every point of this region is one 
where the saltus function w(f, 2, y) is equal to or exceeds A. On 
any line 
Y = Yo 
lying in this region every point is such a point. Let (2, yo) be any 
point on y = y such thata <x, <0. Since 
w(f, v1, Yo) = A, 
we can find some point (a, y:) in the neighborhood of (x, ye) for 
which 4 
| f(a, yo) — f@, ws) | > >: (6) 
Since f(x, y:) is continuous in 2, there exists upon the line y = y, 
an interval (a, 6:) lying within (a, 6) such that for every z within 
a, b;) we hav = 
(ay, by) wehave "| /Gn vw) — flaw 1 =< (2) 
The value of ¢€ is arbitrary and by taking it sufficiently small we 
have for every x in (a, by), upon combining (6) and (7), 


| F(x, yo) — f(@, ) | > 4. S) 
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Within the projection of (a, b:) upon y = y select any point (X2, Yo). 
This point is also one for which 


w(f, ve, Yo) 2 A. 


In any neighborhood of (x2, yo) there must then exist a point (Zp, Yo) 
for which we have 
| f (x2, Yo) se f (x2, Y2) 


As (X2, yz) may lie arbitrarily close to yo, we may so select y2 that 
it lies between yo and y;. There must exist upon y = y; an interval 
(a2, be) lying within (a, b,) such that for every x in this interval, we 


have = 
| f(X2, Yo) i f(a, Y2) | me G3 (10) 
By the proper selection of €, we have by combining (9) and (10) 


| f(x2, yo) — f(x, y2) | > a 


A 
aoe (9) 


which holds for all values of x in (dg, be). Select a point (2x3, yo) 
lying within (ae, b2) and proceed as before. In this manner we obtain 
the general relation 


A 
| fn; Yo) — f(%; Yn) | > Zn = 1, 2, 3, > sae) (11) 

for all values of x within an interval (dn, bn) and yn between yp-1 
and y. We have so selected the intervals (ay, 6b») that 

ROE <i) CREE) eS oe oe, 

(a) Se lose 23 lop Se -c 2 2 Slay Bouc 

We now impose upon the a, and 6, the further condition that 
L an = L bn = X. 


nao NC 


The point x is common to all of the intervals (an, bn), and hence the 


points 2%, 72, 73, - - - are dense at 2. Because of the continuity 
of fle, yo) we have =, f(s, yo) = fe W)- 
T,X 


Written as an inequality, this relation becomes for all values of n 
greater than a certain number m 


| f(ao, Yo) — f(an, Yo) | < € (12) 


As 2 is common to all the intervals (dn, 6.) we have from (11) 


| fm, yo) — f(, Yo) | > (13) 
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By combining the inequalities (12) and (18) we have for a sufficiently 


small € A 
| F(®o, Yo) —f(%o, Yn) | > a” > m. 


The values of the set {yn} were so chosen that they are dense at 
yo. If the limit L (xo, yn) exists we must have from the above 
Yn Yo 


L f(o, yn) = B A f(xo, Yo)- 


YnYo 


inequality 


Hence, either the limit L f(xo, y) does not exist, or if it does it is 
YY 


different from the value of f(z, y) at (xo, yo). In either case f(x, y) 1s 
not continuous in y at (20, yo), Which is in contradiction to the hy- 
pothesis that f(z, y) is continuous in z and in y. From this contradic- 
tion, the theorem follows. 


THEOREM IX. Jf f(z, y) ts continuous with respect to each variable 
separately in a closed region R, then zt is at most point-wise discontinu- 
ous with respect to (x, y) together, and the points of continuity in (x, y) 
form a set having the cardinal number of the continuum. 


Suppose we have given a sequence of numbers {7,} such that 
m > N2 > 5 Te > Nn > nil > ee, 
and A eS |S 


n—-c 


From Theorem VIII it follows that if f(x, y) is continuous in xz and 
in y, the set of points E, where the saltus w(f, x,y) is equal to or 
greater than 7; can not be everywhere dense in R. Likewise, the set 
FE» where w(f, x, y) is equal to or greater than 72 can not be everywhere 
dense in R, ete. In general the set EZ, where the saltus is equal to 
or greater than 7, can not be everywhere dense whatever value is 
given to n. The set H formed from the sum of these sets, that is 


Bim By Bie Bg i en 


is of the first category. This set E is also the set of all the points 
of (x, y)-discontinuity of f(z, y). Its complementary set C(£) is the 
set of points where f(x, y) is continuous in the two variables together. 
Since F is of the first category, it follows from Theorem III of Art. 18, 
stated for two-dimensional sets, that C(£) must be everywhere dense 
in R, and hence f(x, y) is at most point-wise discontinuous in this 
region. 

From Theorem V of Art. 18, it follows that the point set C(B), 
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that is the points where f(z, y) is continuous in x and y together, also 
has the cardinal number of the continuum. 

As we have already seen, a function f(z, y) which is continuous 
in x and in y may still be discontinuous in x and y together. It will 
be shown in a later article! that these points of discontinuity may 
be everywhere dense in the given region. However, the points at 
which the (2, y)-saltus exceeds any given number can not be every- 
where dense in any portion of that region. 

In the previous article, we discussed the conditions that the limit- 
ing function f(z, yo) should be continuous in 2, if f(z, y) is continuous 
in x for y ¥ yo and f(z, yo) is defined by the limiting value 


F(z, yo) = L f(a, y). 
YYy 
The limiting function f(z, yo) may be discontinuous in x at certain 
points as the following exercise shows. 


Ex. 2. Determine the points of discontinuity of f(z, yo) in the interval (0, 1), 


where yo = 0 and where, for z #0, y ¥ 0, we have 
I 


(1 +sin “) 1 
L 
(1+sin 2) 41 

x 


(1+sin 2) -1 
fo aaa ee O<2 1. 


F(Z, y) = 


We have _ f(z, 0) = 


This limit has the value zero for 


z=1 1, 1 Ars one) 1 tate: Ay 
Garo oop) 
: : 1 1 
since apts these values sin = is zero. However, for Spal KT a, We have 
0 <sin— S 1 and we get ; 1 
(1; sin) 1 (1 +sin 4) 
f@, 0) = L 1 L 1 =1 


i » we have 0 > sin = > — 1 and hence 
2n —1 Ay 


(1 +sin =) —1 
Ke LS el, 
Sg (1+sin ee 


1 See Art. 64. 


On the other hand, for x Ne 
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Consequently the function f(x, 0) is discontinuous at the points 


We shall now examine the limiting function f(z, yo) for points of 
discontinuity. Can this function be a totally discontinuous function 
of «? Are there points on the boundary y = yo at which f(z, y) is 
continuous in the two variables (x, y) together? If such points exist, 
what are some of the characteristic properties of the set of such 
points? The importance of these questions becomes apparent when 
we reflect that any property which the limiting function f(x, yo) may 
have holds for the special case where we consider the limiting func- 
tion of a sequence of functions { f,(x)}, or a function defined by an 
infinite series. We shall answer these questions by establishing the 
following theorems. 


THEeorEM X. Let f(x, y) be continuous in x for y ¥ yo and 
asx sb, and suppose f(x, yo) to be defined by the relation 


EAN y) ra eG, Yo): (a) 


Then f(x, yo) can be at most a point-wise discontinuous function of x, 
and hence the points of continuity form a set everywhere dense in (a, b) 
and this set has the cardinal number of the continuum. 


Let # be the set of points of discontinuity of f(x, yo) where the 
x-saltus is equal to or greater than any arbitrarily chosen, positive 
number A. We shall first show that the points of H can not be 
everywhere dense in (a, b). To prove this we shall assume the con- 
trary to be true and prove that this assumption leads to a contra- 
diction. Denote by w(f, x, yo) the saltus of f(x, yo) as a function of 
x. Since EH was assumed to be everywhere dense in (a, 6) then every 
point of this interval is a point of EL. 

Consider a sequence of points {x,} on the line y = yo satisfying 
the condition 


| Fon 0) — Flea, ww) | 2 4 (14) 

For each z, of this set the relation (a) holds, and hence we have 
| f(@ny Yn) — f(n; Yo) | < 5 Yo <Yn < Yo + 4, (15) 
where n = 1, 2,3, - - + , and the points y, are so chosen that the se- 


quence {yn} is dense at yo. Since f(z, y) is continuous in x for y ¥ yo, 
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we have on each y = y, an interval (an, Bn), n = 1,2, 3,00 = Ssuch 
that for all values of x in this interval we have 


| $2, Yn) ~ fm Yn) |< 5p On << Br (16) 


Combining the inequalities (15) and (16) we obtain 


| F(x, Yn) — f(@n, yo) | < €, (17) 
which holds for y, sufficiently close to yo and for all values of x in 
(Qn, Bn), mn = 1, 2,3,- + +. The intervals (a@,, B,) may vary with 
Yn, but they can be so chosen that each lies within the preceding 
one, and the points z, may be so chosen that x, lies within the 
interval (@,, 6,) as indicated in the accompanying figure. 


Fig. 28 


As (17) holds for all integral values of n, we have also the inequality 


[Sansa Yo) i f(a, Yn41) | << €, (18) 
where Yo < Ynui < Yn, ANd Lp < Xnyi < Bn. Combining the inequali- 
ties (14), (17) and (18), we obtain 


| (2, ve) ~ fe, youn) | > (19) 


provided ¢€ is chosen less than = Since each interval (a, Bn) lies 
within the preceding one, it follows that {z,} has at least one limiting 
point 2» which can replace the x in (19). Hence, we have for all 


values of n Hi 
| f(xo, Yn) = f (xo, Ynt1) | > rs 


and consequently the limit given in (a) can not exist for x = 2. 
From this contradiction, it follows that the points where f(x, yo) has 
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a saltus function @(/, 2, ye) equal to or greater than A can not be 
everywhere dense in (a, 6); that is, the points of FE are not every- 
where dense in this interval. 

Consider now a sequence of values {7}, where 


A> ho SS eS ee 
and L y.=0. Lect G denote the set of all points of discontinuity 
of f(z, uw). Denote by £, those points of G where 
@(f, z, ye) = m- 
From the foregoing discussion, F; can not be a set of points every- 
where dense on y = yp. Similarly, let E, be those points of G where 
the saltus is equal to or greater than m2, ete. In general let E, be 


the set composed of those points of @ where the value of w(f, z, yo) 
is equal to or greater than 7.. We have then 
C= E+ yt oe 

where none of the sets E, areeverywhere dense in the given inter- 
val. The set G is then of the first category. The complementary 
set C(@, that is the set of points where f(z, yo) is continuous in 2z, 
must be a set of the second category. It is then everywhere dense 
and moreover has the cardinal number of the continuum, as the 
theorem requires. 

Let us consider the possibility of the existence of points on the 
line y = yo where the limiting function f(z, yo), as already defined, 
shall satisfy the condition 

L f(x,y) = fe, yo)- 
=-h 
rm 
Such a point may be conveniently characterized by saying that 
F(z, y) converges uniformly * at (x, yo). In this connection we have 
the following theorem. 


Tueorem XT. If f(x, y) ts continuous in x for y ~ y, a= 2 <b, 
and tf j(x, ye) ts defined by the limit L f(z, y), then the points on y = yo 
rR 


where f(x, y) converges uniformly form a set which is everywhere dense 
tn (a, 6) and has the cardinal number of the continuum. 


Let (@, 8) be any subinterval of (a,b). From Theorem X it 
follows that in some portion of (a, 8), say (a, 8;). the z-saltus of 


1 See Encyclop. der Math. Wiss., Vol. 2, C: 9, p. 1141. 
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f(x, yo) must be less than an arbitrarily chosen positive number e 
at every point. We shall assume that in this interval (ay, 6,) there 
exists no point at which we have L f(a, y) = f(z, yo), and show that 


y¥~ Vo 
this assumption leads to a false conclusion. Then, at every point 
the (x, y)-saltus is different from zero and hence in some portion of 
this interval, say in (a, 82), this saltus must exceed some positive 
number A. It then follows that in every neighborhood of any point 
(x2, Yo) Of (a2, 62) there exists another point (%2, y2) such that 


- A 
| (Za, yr) — f(x, yo) | > Zz? Yo< yz < yor d. 


Because of the continuity of f(x, y2) in x, we have an interval (a, Bs) 
on y = yo and lying within (a, 6.) such that for all values of x in 
(a3, 83) we have ~ € 
ila, Yo) — f(%, Yo) | < 5° 

Let x3 be any point in (a3, 63). In every neighborhood of (as, yo) 
there exists a point (%3, y3) such that 


=. A 
| f(s, ys) — f(xs, yo) | > 9” Yo < Y¥3 < Ye: 


Again, because of the continuity of f(z, y3) in 2, there exists within 
(a3, 63) an interval (a4, 84) such that for all values z in this interval, 
we have .. € 
| f(z, Ys) — f(s, Ys) | s a 

Continuing in this manner, we obtain a sequence of intervals (an, Bn), 
each lying within the preceding, such that 


| f(Zn, Yn) — f(%n, Yo| > = (20) 


| f(@, Yn) — FG a ym | < 5p (21) 


where the set of values {y,} is dense at yo and the values of the 
set {x,} may be so chosen as to be dense at x. Then, since at 
(20, yo) the «-saltus of f(x, yo) is less than €, we have an interval 
(%» — dy, Xo + Sy,) such that for each a, in this interval we have 


| Fan yo) — f(x, wo) | < 5: (22) 


A 
Combining (20), (21) and (22) we have for € < a 


[ f(a, yn) — F(t0, yo) | > = 
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where x is taken in a sufficiently small neighborhood of a. It then 
must hold for 2» itself; that is, we have 


| f(%o, Yn) — f(Xo, Yo) | > a 


for each y, of the set {yn} sufficiently close to yo. It follows then that 


the limit L f(xo, y) can not exist, which is contrary to the given 
y— Vo 
hypothesis. Hence, in the interval (a, 8) there must exist at least ~ 


one point where L fi -yyr= IG, Yo)s 


zwL—Xo 
y¥~Yo 


that is, there must exist at least one point where f(z, y) converges 
uniformly. As (a, 8) is any subinterval of (a, b), it follows that these 
points are everywhere dense in (a, 0). 

It may be shown in the same manner as in the proof of Theorem X 
that these points must have the cardinal number of the continuum. 
This part of the proof is left to the reader. 

In the foregoing discussion one may replace y in f(z, y) by a set of 
constants {y,} dense at yo. We have then a sequence of functions 
of x alone {f(z, y,)} which can be conveniently written 


di(z), g2(x), Pile a beans Du(D): chy Iteame 6 


All of these functions ¢,(x) are continuous in 2, and the limit of the 
sequence is $(x), where 


P(x) = f(x, Yo) 


which at most can be point-wise discontinuous. It follows from the 
properties of the limiting function that the limit of a sequence of 
continuous functions is at most point-wise discontinuous. The con- 
verse is also true, namely that every point-wise discontinuous func- 
tion may be represented as the limit of a sequence of continuous 
functions. Hence, a necessary and sufficient condition that a func- 
tion can be represented as the limit of a sequence of continuous 
functions is that it be at most point-wise discontinuous.! It follows 
also that every function which is the limit of a sequence of poly- 
nomials is necessarily continuous. 

The consideration of the character of a function which may be 
represented as the limit of a sequence of functions leads to what is 
known as the Baire classification of functions.2 In class zero he 


* See Baire, Lecons sur les fonctions discontinues, p. 124. 
® See Baire, ibid., p. 126. 
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puts all continuous functions. Class one is composed of all those 
functions which are not continuous but are the limits of sequences 
of continuous functions. In class two are put those functions which 
are the limits of sequences of functions of class one and do not belong 
to class zero or class one. In general, a function is said to be of class a, 
if it is the limit of a sequence of functions of class w — 1 and does not 
belong to any one of the classes 0, 1,2,- --,a—1. 

Any point-wise discontinuous function is an illustration of a func- 
tion of class one. It is of interest to note that it has been shown 
that there exist functions of every Baire class of finite order,! and 
that functions may be defined which do not belong to any such class.2 


THEOREM XII. A bounded function of class a> 0 may be expressed 
as the limit of a sequence of functions of class less than a which have the 
same bounds as the given functions. 


By hypothesis the given function f(x) is bounded. Denote the 
least upper bound by A and the greatest lower bound by B. If the 
functions of the sequence {f,(2)} defining f(x) are such that their 
bounds do not exceed those of f(x) for finite values of n, they are, 
nevertheless, equal to those of f(a) in the limit as n becomes infinite. 
In case the bounds of f,(x) do exceed those of f(x) for some values of n, 
we may replace f,(x) by another function @¢,(x) defined as equal to 
fn(x) for those values of x for which A 2 f(x) 2 B and equal to A 
for those values of x for which f,(x) > A and likewise equal to B 
for those values of x for which f, (2) < B. Having replaced f,,(a2) by 
n(x), we can in this case also conclude that f(a) may be defined as 
the limit of a sequence of functions having the same least upper and 
greatest lower bounds as f(x) itself; that is, by the sequence {¢,(2) } 
which has A and B as its least upper and greatest lower bounds, 
respectively. 

It is to be noted that the class of the function f(x) is not increased 
by thus restricting the bounds of the functions of the sequence de- 
fining it. For example, it will be seen at once that this is true where 
f(z) is a function of Baire’s class zero, since in this case f(x) is con- 
tinuous and is the limit of continuous functions. That the same is 
true of functions of any class follows at once from the fact that by 


1 See Borel, Lecons sur les fonctions de variables reelles, p. 156; also Lebesgue, 
Liouville’s Journ. (6) Vol. 1 (1905) p. 139. pee 

2See Lebesgue, Liowville’s Journ. (6), Vol. 1 (1905), p. 213; also Sierpinski, 
Fundamenta Mat., Vol. V (1924), p. 87. 
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thus restricting f,(z) we do not introduce any new points of discon- 
tinuity and may indeed reduce the number of such points. It fol- 
lows then that f(x) is of class @ or less irrespective of whether it is 
defined by the sequence {f,(z)} or by the restricted sequence {@,(x)}. 
With this conclusion the proof is completed. 


TurorEM XIII. Any function of classa>Ov1s the limit of a 
sequence of bounded functions of class less than a. 


If the given function is bounded, then the theorem is identical with 
the preceding. If the given function f(x) is not bounded, the proof 
is similar to that of the preceding theorem except that we replace f,,(“) 
by $,(zx) defined to be equal to f,(x) where — n S f,(x) S n and equal 
to — n where f,(x) < — n and to n where f,(“) > n. 


TueoreM XIV. The sum or the product of two functions which are 
finite and of class a is a function of class not greater than a. 


The theorem may, of course, be extended to any finite number of 
functions. It follows at once in case the given functions f(x) and F(a) 
are continuous; that is, of Baire’s class zero, since the sum or product 
of two continuous functions is a continuous function. 

Let us assume f(x) and F(x) to be finite and of classa>0O. We 
i abememae (Cue hercayedcayen hohe: (23) 
where f,(z), F(a) are of class less than a. We shall now assume that 
the theorem holds for classes less than @ and show that it holds for 
class a. The theorem then follows, since it holds for continuous 
functions, that is for class zero, and hence for class one, class two, etc. 
Since it holds for classes less than a, it follows that f,(x) + Fn(z) is 
of class less than a. By adding the relations given in (23), we have 


f(z) + F@) = L thule) + Falz)}; 


that is, the sum f(x) + F(x) is the limit of a sequence of functions of 
class less than @ and hence is of class not greater than a, which was 
to be shown. In case the singularities of f,(x) and F,(x) are such that 
by adding these two functions some of them disappear, it may be pos- 
sible that the class of the sum will be less than that of either function 
and consequently the class of f(z) + F(x) may be less than a. 

By multiplying the two equations given in (23) member by mem- 
ber, we can by a similar argument establish the theorem for the 
product of two functions. 
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EXERCISES 
1. Show that f(x) = sin 5 for x # 0, where f(0) = 0, is finite for every value of 


x in the interval (— 1, 1) but is not bounded. Plot the graph. Determine the 
point of discontinuity. What is the amount of saltus? 
2. Evaluate the following limits, or show that the limits do not exist. 


bs Te, cbae y+(at+y)?. 

(a) a Qn cos 5) ) (b) feel al ae ee (c) gen aie = + y)?’ 
nares 5 
(@) L nate-™’; (Seay 
n—> oo z—0 a-y 
y0 
3. Given the function f(z) = L [ L (cos m! ial | Show that f(x) is one 
moa | n—-00 


for all rational values of 2 and zero for all irrational values of x, thus being totally 
discontinuous in the interval © 1). Is this function a semi-continuous function? 
1 
4. Let f(x) =—— + sin (al [ » for « ¥ 0, and let f(z) = 0, forzx =0. Discuss 
1+¢ 
the discontinuity of f(x) at the origin. What is the maximum value of f(z) at 
0s 1 
5. Given f(r) = : 


sin mlz 


Show that f(x) can be made discontinuous at 


l+e 
any rational point in the interval (0, 1) by the proper selection of n. Is it point- 
wise discontinuous? 
6. Show that if a function is continuous the number of oscillations greater 
than A must be finite in any finite interval. 
7. In the closed interval (— 1, 1) let f(x) be defined as x? sin ~ = I for x ~ Oand 


as zero for x = 0. In the given interval is this function aaa, Is it continu- 
ous? Is it uniformly continuous? Is it absolutely continuous? Is it semi- 
continuous? What is the maximum value of its saltus? 


8. Given f(z, y) = ae when either or both of the variables are different 


from zero, and let f(0,0) =0. Show that in the region where x = 0, y = 0. 
f(x, y) is bounded for each constant value of x and for each constant value of y, 
but not bounded in (g, y). 

9. Given f(a, y) = log (2? + ¥? aye if either or both of the variables are different 
from zero. Moreover, let f(0,0) =0. Examine the function at the origin for 
continuity as to z, as to y, as to (z, y) together. 

10. Show that every rational function is continuous at every point where it 
is neither infinite nor indeterminate. What is the most general set of points of 
discontinuity which such a function may have? 

11. Set up a’function f(z, y) such that when one puts z = p cos 0, y =p sin 9, 
a function F(p, 9) is obtained such that L F(p, 8) = 0 for each value of @ and 

p—' 


yet f(x, y) is discontinuous in (z, y) at the origin. 

12. Give a function f(z, y) which is continuous in x and in y but which does 
not converge uniformly to the limiting function f(z, 0). 

13. Is it possible to have a point-wise discontinuous function which has 
points of discontinuity at a set which is perfect and not everywhere dense? 
Give the reason for your conclusion. 
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14. Show that if f(x) is continuous with respect to a bounded, perfect set Z, 
then it is uniformly continuous with respect to H (Compare Theorem I, Art. 26), 


2 
15. Given f(z, y) = ma 7’ y # Oand all values of z, and let f(0, 0) = 0. Test 
f(x, y) for quasi-uniform convergence to the limiting function f(x, 0). What can 


one say concerning the continuity of the limiting function? 

16. Prove Theorem I, Art. 26 by aid of the Heine-Borel Theorem. 

17. Could one have a point-wise discontinuous function f() whose points 
of continuity form a discrete set? an enumerable set? a set of the first species? 
a set of the first category? a closed set? a perfect set? a closed set of measure zero? 

18. If f(x) is a rational integral function defined for the interval (a, b), does 
it take all values between f(a) and f(b)? Is it uniformly continuous in (a, b)? 
Does it have a maximum and a minimum in (a, b)? Can it be represented as the 
limit of a sequence of continuous functions? 


19. Givenf(z, y) =e * cos = for y #0, where we put f(z, 0)= L f(a, y). 
y>0 


Does f(z, y) converge uniformly to f(z,0)? Does it converge quasi-uniformly? 
Is the limiting function f(z, 0) discontinuous? What is the Baire class to which 
f(x, 0) belongs? 

20. Given a function f(z, y) which is continuous in x and in y in a closed region 
R. What statements can you make concerning the projection upon the X-axis 
and the Y-axis of its points of (a, y)-discontinuities? 


CHAPTER IV 
DERIVATIVES AND THEIR PROPERTIES 


29. Definition of a derivative and of a derivative number. If we 
denote by Az an increment of 2, then f(z) is said to have a finite 
derivative at the point 2 provided the limit 


f(%o + Ax) — f(xo) 
Rese Ax (1) 


exists. The derivative is also said to exist if this limit becomes 
definitely infinite; that is, if as Av approaches zero the value of the 
above difference quotient increases indefinitely without oscillating 
between positive and negative values. In this case the function is 
said to have an infinite derivative at the given point. The derivative 
is often spoken of as the differential coefficient and is denoted by the 


symbols a 
Diy, ©, ¢ 
Y dz f (20). 


The aggregate of values of the derivative for all values of x under 
consideration is called the derived function and may be denoted by 
f'(2). 

In order that f(x) shall have a finite derivative, it is necessary that 
the numerator of (1) shall vanish as Ax approaches zero; that is, 
j(x) must be continuous at v. For example, the function 


f(a) = sin * x £0, 
= 0, x =0, 


can not have a finite derivative at the origin; for, although the func- 
tion is finite in the neighborhood of the origin it is discontinuous at 
that point. It can not have an infinite derivative at the origin 
because the limit given in (1) is not definitely infinite. 

If the difference quotient has a limit as Az approaches zero through 
positive values, we say that f(x) has a right-hand derivative at 2%; if 
the limit exists as Az approaches zero through negative values, then 
f(x) is said to have a left-hand derivative at x. Hither or both 


the right-hand and left-hand derivatives may exist without the 
149 
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function having a derivative at the point. If the right-hand and 
left-hand derivatives are equal, then the common value of the two 
is the derivative at the point. In the case of infinite derivatives the 
right-hand and the left-hand deriva- 
tives must have the same algebraic 
sign. 

For example, if we have given 


Y; 


Y= wt, 

X the corresponding curve has a cusp at 
the origin as shown in Fig. 29. Al- 
though the curve has a tangent at the 

dy 


Fia. 29. origin, the derivative qq cam not be 


said to exist at this point, since the right-hand derivative is plus 
infinity, while the left-hand derivative is negative infinity; for, we 
have for positive values of Ax 


19 f+ Az) — fO) _ if (Az)* _ 8 Lin ia 
Az—0 Ax Az-—0 Ax 4 Az—0 (Ax)? 6 ; 
and on the other hand for negative values of Ar we have 
zy, 10-49 =fO _ zy, &- Av i po ogee 


Az—9 — Ax - Az—0 (- Az) ‘ Az—0 (Azx)3 . 


dx 
dy 
Suppose that we put for convenience 


The derivative — does exist, however, at the origin and is zero. 


F(a, Az) = oe Ax = 0, 


and consider the oscillation of F(a, Ax) as Az takes all values sub- 
ject to the condition that xz) + Az shall lie in a given interval 
(a, 6), 2 being a given point in that interval. We shall denote by 
M(F, Az, x) and m(F, Az, x) the least upper and the greatest lower 
bounds, respectively, of F(a, Ax) as Az takes all values in the 
neighborhood of zero. Then, if f’(xo) exists, the saltus of f’(x) at x 
may be written 
w(f’, to) = M(F, x) — m(F, 2), (2) 
where M(F, 2) and m(F,2) are respectively the limits of 
M(F, Az, xo) and m(F, Az, x) as Az approaches zero. 
It is often convenient to distinguish between the right-hand and 
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the left-hand limits of M(F, Az, a) and m(F, Az, 2) as Ax ap- 
proaches zero. For that purpose put 


D* f (2x0) = nN L M(F, Az, Xo), (3) 
/ xz—Ot 
Ds f (xo) = ‘ ae: m(F, ANCE Xo). 


The value D* f(x) is called an upper right-hand derivative number ! 
of f(x) at x, and D f(x) is called the lower right-hand derivative 
number of f(x) at x. Likewise, the relations 


D-f(20) ay LM, Az, Xo), (4) 
D_f (2x0) = Ty mF > Ae) av); 
Rte 


define respectively the upper left-hand derivative number and the 
lower left-hand derivative number of f(x) at x. The four numbers, 
D* f(xo), Dsf(xo), D-f(xo), D-f(xo), are also often spoken of as the 
four derivates at the point, or the upper and lower right-hand or left- 
hand derivatives. A derivative number may be said to be + or 
—o if one of the foregoing limits becomes infinite with a definite 
sign as Ax approaches zero through positive or negative values. One 
may call the aggregate of the values of the derivative numbers the 
upper and lower derivative functions. 

If the upper and the lower derivative numbers are all equal at 
any point 2, then of course the derivative f’(zo) exists and is the 
common value of the derivative numbers. In fact, the derivative 
at a point may be defined as this common value. All the rules for 
differentiation as given in elementary calculus can be readily de- 
veloped upon the basis of such a definition.’ 

The geometric significance of the derivative numbers may be 
readily shown. In Fig. 30, let P be any point on the curve y = f(a), 
and let x be the corresponding value of x. Suppose Q to be any other 
point on the given curve and denote its abscissa by a + Az. For 
the right-hand derivative numbers, we shall consider Az as positive. 
Join P with the point Q of the given arc bya straight line. If Q takes 
different positions on the curve, all lines PQ will fall within some sec- 


1The notion of upper and lower derivative numbers was first considered by 
DuBois-Reymond, Abh. Akad. Miinchen, Vol. 12 (1876), and Dini, Fondamenti 
per la teorica delle funzioni di variabili reali (1878). The notation used in the 
text is due to Scheeffer, Acta. Math. Vol. 5 (1884), p. 52. 

2 See Caratheodory, Vorlesungen viber Reelle Funktionen, pp. 518-627. 
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tor, say APB. As Az decreases and approaches zero, this sector 
never increases although it may decrease. Let PA’ and PB’ be 
the limiting positions 
of the lines PA and 
PB, respectively, as Ax 
approaches zero. The 
tangents of the angles 
which PA’ and PB’ 
make with the positive 
ay X-axis may be taken 
Fia. 30. as the geometric inter- 
pretations of the derivative numbers Dt f(x) and D,f(x). Corre- 
sponding interpretations of the left-hand derivatives also exist. 

In discussing the properties of a function, the derivative numbers 
may often replace the ordinary derivative. For example, if the 
right-hand derivative number D,f‘x) is positive for x = %, the 
function is increasing with x at that point. If the left-hand derivative 
number D_f(x) is positive for x = %, then f(x) is increasing as x 
decreases. If we have 

D* iGO 2 DAF Ge20; 
then f(z) has a maximum value at 2%. If, on the other hand, 

D-f(xo) <0, Dsf(xo) > 9, 
then f(z) has a minimum value at x. If for all values of x the two 
right-hand derivative numbers of a continuous function f(z) are 
never both negative or both positive in the given interval, then in 
that interval f(x) can neither increase nor decrease and hence must 
be a constant. In the discussions to follow we shall be interested only 
in the properties of derivative numbers of continuous functions.* 

The derived function f’(z) may in turn have a derivative, which 
is called the second derivative of f(x) and is denoted symbolically by 


Te 
Die 


If f’(x) exists at each point of an interval (x) — 6, x + 6) and is con- 
tinuous at 2, then the second derivative at x = x is given by the 


aN yp Lea + Ae) — f'(a) (5) 


Az-0 Ax 
1 For a discussion of the properties of derivative numbers of discontinuous 
functions, see W. Sierpinski, Fundamenta. Math., Vol. 3 (1922), pp. 123-127; also 
St. Banach, zbid., pp. 128-132. 
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or by the iterated double limit 


if zp Lo + Aye + Asx) —f(xo + Aix) —f(xo + Asx) tf (20) . (6) 
A,r0 ee Ay Aor 


One might infer from (6) that it would be permissible to put 
Aix equal to Azz and thus obtain f’’(2) from the limit 
f(to + 2Ax) — 2f(ao + Ax) + f(a). (7) 
Az—0 (Az)? 
This method is not always possible, as the following illustration 
shows. 


Ex. 1. Given f(x) = zx’ cos * for x ~ 0, and let f(0) = 0. Consider the exist- 
ence of f’’(0). 1 
The first derivativeis f’(x) = 32? cos = +2 sin * Ow (0) 


ars 


The derived function f’(z) is continuous at x = 0 and exists at every point in the 
neighborhood of this point; hence, if f’’(0) exists, it is ae by the limit 


E £O+ Az) -f'@O _ L | 3A £08 ; ting | 


Azr0 Az ~ Az0 
But this limit does not exist, since the limit LZ sin — does not exist. From (7) we 
have etpae re 
{0 + 2Azx) — 20 + Ax) +f(0) _ al 
8A — — 2A — 
Rae (Az)? reas XL COS si LCOS male 0, 


and consequently f”(0) is not given by this limit. 
We may, however, state the following theorem. 


TueoreM! J. Let f(x) be a continuous function in the interval 
(a,b). If the first and second derivatives f’(x), f’'(x) exist and are 
finite for x = X, where a < x < b, then it follows that 


” #3 f(to + Ax) — 2f(ao) + f(ao — Az) 
cs) see (Az)? Y 
0 A = 2 0 A 0 


We shall ee the auxiliary function 
(a) =f@) -5 5 2%, (8) 


where k is an arbitrary constant. oe f’’(x) exists at x, it follows 
that f’(x) must exist not only at 2, but at every point in a neighbor- 


1 See Dini, Grundlagen, Art. 174. 
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hood (ao — 6,2) + 6) of x. If we choose Az sufficiently small so 
that 2) + Az lies within this subinterval, we may write, by aid of the 
Law of the Mean,! 


b(t + Ax) — (a) = Ax dg'(m+ AAz),0<& <1, 
(x) — Ax) — h(a) = — Az G'(ao — O2Az), 0 < 02 <1. 
Adding these equations, we have, after dividing by (Az)?, 
(ao + Ax) — 26(x0) + O(a — Az) Sy h'(to+ Ax) "(to - 6,Az) 


a (to + Ax) — $’ (x0) is ' (xo — O2Ax) — h’ (0) 
Az ae 
' (%o + Ax) — $' (xo) ' (x — O2.Ax) — $' (a0) 
ae 6, Ac + 4: = PsAgn Pa 
From (8) we have hb" (ao) =f’ (xo) — k. 


As k is an arbitrary constant, we will now assign to it the value 
f’’(xo), and hence we have 
$''(xo) = 0. 


In (9) the fractions in the second member define in the limit, as Ax 
approaches zero, the right-hand and left-hand derivatives, respect- 
ively, of $’(x) atx =2. But as $’’(%) is zero, both the right-hand 
and the left-hand derivatives must be equal to zero, and we have 


L (xo + Ax) — 2h(xo) + (to — Az) _ 
Az—0 (Ax)? . 
Replacing $(x) by its equivalent given in (8), we have 


f(Xo eG Az) a 2f (xo) + f(xo =. Az) yr 
en (Az)? par 


0. 


which is one of the conclusions stated in the theorem. 
We may also write, by aid of the Law of the Mean, 


P(x + 2Az) = (xo) = 2Axrd’ (xo + 20,Az), 0 << 6, << 1, 

b(t + Ax) — d(%) = Axd’(a + O2,Azx), 0 < 62. <1. 
By a process of reasoning similar to that used in the first part of this 
proof, we are led to the second conclusion of the theorem; namely, 


AO (Az)? = f’’ (x). 


1See Art. 31. 
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30. Continuous functions having no derivative. It was pointed 
out in the previous article that a function must be continuous at a 
given point in order to have a finite derivative at that point. The 
converse is not true, as the following example shows. 


Ex. 1. Given the function f(z) = x sin » x #0, where f(0) =0. Show that 


f(x) is continuous at x = 0, but has no derivative at that point. 
As we have seen (Ex. 2, Art. 23) 
1 Der ae = (0) 
x0 v 
and hence f(x) is continuous at this point, smce L f(x) =f(0). The function, 
a2—0 
however, does not have a derivative at this point; for, 
Az sin an 
Ti f@ + Ax) ~fO) _ ip Ac _ L sin cs 
Az—0 Ax Arso = At Azo) Ag 


and this limit does not exist, since the sine of nee oscillates between the values 
: : Ax 
plus one and minus one (see Fig. 11). 

It must not be assumed that the derivative failed to exist in the 
foregoing illustration merely because of the infinite number of oscil- 
lations of f(x) in the neighborhood of the origin. The following 
example shows that f(a) may have an infinite number of oscillations 
in the neighborhood of a point and still have a derivative. 


Ex. 2. Given f(x) = x? sin * x ~ 0, where f(0) = 0. Find the derivative of 
Hioone — Al. 


We have L z*sin bs 0 = f(0), 
z—0 x 
and hence f(z) is continuous at the origin. The derivative exists at this point; 

for, we have BAS 

{0 + Ax) - f(0) ede 1 

2) — a F 
(0)= D Wea = EL ———= LF Arcsin — =0. 
#0) Az—0 Az Az—0 Ax Az—0 Ax 


Formerly, it was assumed that all continuous functions must have 
a derivative at every point, or at least with the exception of at most 
a finite number of points. The investigations of Riemann! and 
Bolzano 2 showed that functions exist which fail to have a derivative 
at certain sets of points. Weierstrass * was the first to give an example 


1 Gétlingen Dissertation (1854); Werke, 2d Ed., p. 229. 

2 See, Encyklopddie der Math. Wiss. Vol. II, p. 1091. 

3 Announced in a lecture course at Berlin in 1861. See, Abh. aus der Funk- 
tionenlehre, p. 97. This function is defined by means of an infinite series and the 
conditions stated by Weierstrass have been extended since by various writers. 
For further literature on this subject, see, Hncyklopddie der Math. Wiss. Vol. II, 
p. 1091, footnote 736. 
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of a function which is continuous throughout an interval and still 
has no derivative at any point of that interval. 

We shall now show geometrically how such a function can be set 
up; that is, we shall show how one may construct the successive 
approximations to a curve which is continuous in a given interval 
but which has no definite 
direction at any point.' 

Upon the X-axis lay off 
from the origin the interval 
(0, 1) and upon the perpen- 
dicular through the point 
x = 1 lay off a unit distance 
above the X-axis. Divide the 
unit interval thus formed on 

x the perpendicular into 3 equal 
O| 4, 2,5, 4. 3s Se Fe ge divisions and the interval on 
ast the X-axis into 3? equal parts, 

as indicated in Fig. 31. 


Asx increases through the first division, let y increase from zero to 3" 


: ae 1 
As x increases through the second division, let y decrease from 3 to zero. 


Then as x increases through the third division, let y again increase 


Y 


from zero to - As x goes through succeeding divisions, let y increase 


or decrease as indicated in Fig. 31. If we indicate by Az the incre- 
ments of x by this division and by Ay the corresponding increments 
of y, we have for the first division 

1 ee ree see eee 
oo tat 3 ola ae 
Spe cee Oa ieee rr yg eae ot a! 

oh) Boas poo 

Divide each of the foregoing subintervals on the Y-axis into 3 equal 
parts and the subintervals on X-axis into 3? equal parts. As x 
increases through each of those divisions, let y increase or decrease 
as for the former subdivision. Thus, for the n” division, we then have 


1 Sh geet 1 
Az = 320” 327’ 320 i Ee 32n’ 
a coe | 1 
Ay = Bn’ Bn’ oF cusses? one (1) 


1 See, Steinitz, Math. Ann. Vol. 52, pp. 58-69; also, E. H. Moore, Trans. 
Amer. Math. Soc., Vol. 1, pp. 81-90. 
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It is to be noted that the denominators of Az are powers of 3? = 9, 
while those of Ay are powers of 3. The numerators of Ay are all 
numerically one, each positive one being preceded or followed by a 
negative one. Assume the foregoing method of determining Az, 
Ay to be carried on indefinitely. By this process, the function is 
defined at each point of the sequence 


ay ag Q3 ay Qe An 


Bison Gt 97 Cl gk gre sutitig sige er gece? ae a2) 
where a, d2,- + -,Qn,-° - + may have any of the values 
Ay lea ie cia 


For convenience, we shall denote this set of points by {x}. As the 
numerators a, take all possible values, the points of this set are every- 
where dense in the interval (0, 1), and consequently every point of 
the interval can be represented by a sequence of such points, when 
we include its limiting points, since it is equivalent to saying that 
any real number can be represented in a number system having the 
base 9, which, as we have seen, is always possible. At those points 
which are limiting points of the set {a} and not themselves points 
of the set, we shall define the function f(x) as the limit of the 
functional values in the neighborhood of the points in question. 
With this understanding the function is fully defined for the entire 
interval (0,1). 

The function f(x) thus defined is continuous in the given interval 
(0, 1). For, as will be seen from (1), the maximum oscillation of the 
function in any interval by the n” division, that is the maximum 


value of Ay, is x . As 7 increases without limit, the subinterval Az 
approaches zero and the corresponding oscillation of the function 
also approaches zero. Consequently, the function is continuous in 
the entire interval (0, 1) as stated. 

We shall now undertake to show that f(a) has no derivative at 
any point of the interval (0,1). Let x be any point in the given in- 
terval. In order that the derivative shall exist at 2 we must have 
the same limiting value of the difference quotient 

f(@2) — f(a) 
5 — a 
as 21, Z2 approach simultaneously the limiting value x through all 
possible sets of points dense at a, where 2, and zz are on opposite 
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sides of a. Consequently, if we can find two such sets of points 
which lead to different limiting values, it follows that the derivative 
does not exist at x. For one set of points, we shall make use of the 
points 2 already discussed. As we have seen, these points are every- 
where dense, and hence x») may be made the limiting point of such a 
set. For the values of (x2 — 2) we shall take those values of Az 
given in (1). The corresponding values of [f(x2) — f(a)] are then 
the values of Ay given in (1). For this method of selection, we have 


1 


L -~L+-=-Le=0. @) 


i tac 
2 eames S) 


Ay 
Az 


f(t2) — f(a] _ L 


Te — Vy Ar-0 


no no 


a ll 


From this conclusion, it follows that f(x) can not have a finite de- 
rivative at 2p. 

It ean also be shown that f(z) can not have an infinite derivative 
at 2%; for, in order that this may be true, the difference quotient 
must become infinite with a definite sign as the points x2, 2; approach 
2) in any manner whatever. To show that an infinite derivative does 
not exist, it is sufficient to show that, for a set of values for x, x2 dif- 
ferent from those already used, the limiting value of the difference 
quotient is finite. We shall undertake to show that, for at least one 
such set of values, this limit is zero. To make clear how this may 
be done, suppose we denote the sequence of values of Ay in (1) by 


{An}, k = 1, 2,3, - re ar 
Thus, for n = 1, we have 
1 -1 1 1 
An = 3” Ai = Bry Ais = 3” Ais = 3 


—1 1 1 —1 1 
Ais = — Aw = 3’ Av sy Ais ara Aw = 3° 


It will be observed that of any three consecutive values of Ax, 
one is always of opposite sign to the other two. Consequently, by 
combining each of these values either with the following or with the 
preceding, the sum can always be made zero. The same is true of 
the values of the sequence {A,:} obtained by the n® division. We 
shall make use of such a combination to obtain a second set of values 
for Ay, which we may, for convenience, denote by {A,,}. Thus for 
n= 1, we have 
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Ai, = An + Ais, Ay,:= Aye + Ais, Ays = Aj + Ais, 
Ai F Ais ta Ais, Ais = Ais + Ais, AY = Ais + Ais, 
Ay, = Av + Ais, Avg = Aig + Ars, Avy = Aig + Ais. 


The corresponding values of 


At = %.— 2% 


are all numerically equal to 2 and those of the n* division are 37m" 
The end-points of these divisions of the given interval are also every- 
where dense in (0, 1) and x may be made therefore the limiting point 
of these new points. It will be seen also that each Ay = f(a.) — f(a) 
in the method of division given by (1) is always a subinterval of the 
corresponding value of A’y. Moreover, as Ay approaches zero, A’y 
also approaches zero; in fact, it is so taken that it is always exactly 
zero, before passing to the limit with Az. We have then for the 
new set of values for Ar, Ay 


L |f@) =f@)| _ AY pip LO > oe, 
2X Lo —- Az—0 Az a 2 (4) 
T1721 320 


Since the limiting values given by (8) and (4) are different, it follows 
that the derivative at x» does not exist. As 2 was taken to be any 
point of the interval (0, 1), it follows that f(x) can not have a deriva- 
tive either finite or infinite at any point in the given interval. 

In Art. 19 it has been shown that a one-to-one correspondence 
can be established between the points of a square and the points on 
one side. This relation involves a parametric representation of the 
functional relation between x and y, say 


x= dit), y = al), 


where ¢ takes all values between zero and one. So long as a one-to- 
one correspondence is involved, it can be shown that the functions 
do, $2 can not both be continuous.' If we omit this condition so that 
to a point (x, y) more than one value of t may correspond, then it 
may be shown that ¢:, ¢2 may be continuous and uniquely deter- 
mined functions. Indeed, these functions can be so defined that the 
corresponding curve will be continuous and pass through every point 


of the square O<2e51,0syS81 


1 See Netto, Journal fiir die reine und angewandte Math., Vol. 86 (1878), 
pp. 263-268. 
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at least once, and have no definite direction at any point; that is, 


y is then a continuous function of x and yet the derivative <r, does 
not exist at any point on this space filling curve.’ 

31. Properties of derivatives and derivative numbers. Let us 
suppose that the function f(x) is single-valued and continuous in a 
given interval (a,b). We shall now consider some of the special 
properties of its derivative and derivative numbers. Among these 
properties, that given in the following theorem, known as the Law 
of the Mean, is of fundamental importance. 


TurorEM I. Let f(x) be continuous in the closed interval (a, b), 
and suppose that f’(x) exists fora <x <b. Then there exists a point 


Xo, for which 
10)— fe) se Ae Ui eee 


The given hypothesis assumes the existence of f’(x) merely for the 
inner points of the interval (a, b); that is, for points of the open inter- 
val (a, b). It may be finite or infinite with a definite sign. The given 
function f(x) is continuous at the end-points of the interval as well 
as at the interior points. We shall assume that f(x) is not a constant; 
for, in that case the theorem follows at once, since f’(x) is then zero 
for all values of x. We shall also assume f(b) different from f(a); for, 
if f(b) is equal to f(a) we can always replace the given interval by an- 
other where this is not the case. Consider the auxiliary function 


F(x) = f(0) - s(@) POL @ - 2). 
We have then the relation 
F(b) = F(a) = 0. 


Moreover, F(x) is continuous in the closed interval (a, b) and has a 
derivative at each point of the open interval (a,b). Then by Theorem 
IV, Art. 26, there exists at least one point x interior to (a, b) at which 
F(x) takes its maximum value. We must then have for all values 
of Axi5'0; 


F(a) — Ax) — F(a) S$ 0, F(a + Ax) — F(a) $0 
1 For discussion of such curves, see Peano, Math. Annalen, Vol. 36, pp. 157- 


160 (1890); Hilbert, Math. Annalen, Vol. 38, pp. 459-460 (1891); E. H. Moore, 
Trans. Amer. Math. Soc., Vol. 1, pp. 72-80 (1900). 
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The difference quotients 


F (xo = Axo) = F (Xo) F(x te Ad). = 
— Az Ax 


P(), AG 0 


must be either both zero or of opposite signs. It follows that as 
Ax approaches 0, the limiting values of these difference quotients, 
namely the left-hand derivative and the right-hand derivative, re- 
spectively, must be of opposite signs if both are different from zero. 
As the derivative of F(x) exists at x, the left-hand and right-hand 
derivatives must be equal, and hence each equal to zero. Conse- 
quently, we have 


F'(to) = — f'(@) + LO) _ 9 
f@) =) 


?) 


or =f (05), 2 ag 0; 
as the theorem requires. 

Among other properties of derivative functions, we have those 
given by the following theorems. 


TueorEeM ! II. If f(x) cs continuous and has a derivative at every 
point in an interval (a, b), then f’(x) can not pass from a value A to a 
value B without taking all intermediate values. 


Let 21, 22 be the values of x in the given interval at which the 
derivative is A and B, respectively; that is, let 


S(t) = A, f'@) = B 


We may, without loss of generality, assume B > A. Let us consider 
first the case where one of these derivatives, say f’(x1), is positive 
and the other is negative. For convenience put 


f(c + Az) — f(x), 


Az 


F(a, Ax) = 


Since f(z) is continuous, F(z, Az) is also continuous in x for Az + 0. 
Then there exists between x, and x2 some point 2 for which F(z, Az) 
takes its maximum value. It follows that for all values of Az in the 
deleted neighborhood of zero, we have 


F (2, — Az) => 0, F (xo, Az) < 


1 Due to Darboux, Ann. Ecol. Normale (2), Vol. 4 (1875), p. 109. 
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Since the derivative f’ (x) exists for x = 2, these two functional values 
must approach the common limit zero as Ax approaches zero. That 
h 

is, we have f'(t) = 0. 


In other words, as the derivative function f’(x) passes from f’(2) to 
f’(z2), it must take at some point the value zero. 

We shall now consider the case where f’(x) does not change sign 
in passing from the value A to the value B. Let C be any value 
between A and B. We shall show that there is some value x between 
x, and x2 for which f’(x) =C. As C lies between f’(a) and f’(22), 
it follows that the derivative of the function 


¥(x) = f(z) — Cx 
will have opposite signs at x, and x2; for, when f’(x) takes the value 
A, we have Ui iG eae ee 
which is negative, and when f’(x) has the value B, we obtain 
y'(z) =f'(4) -C=B-C, 


which is positive. It follows from the first part of this discussion 
that there must exist some point x between x, and zz at which y’(z) 
is zero; that is, where 


y'(z) =f'(z) —C =0, 
and hence T (y= C. 


This conclusion establishes the theorem. 
It is of value to note that the difference quotient 


f(z + Az) — f(z) 
Ax 


likewise takes all values between its upper and lower limits in any 
closed interval (a,b). Because, for Ar ¥ 0 the difference quotient 
is fully defined and is continuous in the two variables z, Az. As 
we have seen, every such function takes all values between any two 
of the values which it assumes. 

Because f’(x) takes all values between any two of its values it does 
not follow that it is continuous. Moreover, f’(x) may exist at every 
point in a given interval and still be discontinuous as the following 
example illustrates. 
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Ex. 1. Given the function f(x) = x? sin S| for x ¥ 0, where f(0) = 0. Con- 
sider the existence and continuity of f’(x). 
For x ¥ 0, we have 
fy (ae) wane “tne — cos A 
x a 
For z = 0, we obtain 
Az) — f(0) 


, f(O + at! 
0 — L => — 
f'(0) aes L Azsin é 0. 


Az Azx—-0 


Hence, f’(x) is fully defined in any interval inclosing the origin, but f’(x) is not 
continuous at the origin, since the limit 


LL f(#= L (2: sin te cos :) 
z—0 z—0 x x 
does not exist. 

Tf a function f(x) is continuous and has a derivative at every point 
of an interval, the question arises as to the number and distribution 
of the points of discontinuity of f’(x). This question is settled by the 
following theorem. 


TueoreM III. Jf f(x) is continuous and has a derivative at every 
point of an interval (a, b), then f’(x) is at most point-wise discontinuous 
in this interval. 


To prove this theorem, let us define an auxiliary function F(a, Az) 
of the two independent variables z and Az as follows: 


F(a, Az) CE ee = Ste), for Ax = 0) 


For Az = 0, let 
0) = a —I@) _ pre) 


Azr-0 


for values of z in the interval (a, 6). The function F(x, Az) is con- 
tinuous in x for Ax~#0O and hence satisfies the conditions of 
Theorem X of Art. 28. Consequently, the limiting function f’(#) can 
be at most point-wise discontinuous. 

Asa consequence of this theorem, we have the following corollaries. 


Cor. 1. If f(x) is continuous and has a derivative at every point of 
an interval (a, b), then the points of continuity of f'(a) form a set which 
is everywhere dense in (a,b) and has the cardinal number of the con- 


tunuum. 


1 This theorem and the corollaries to follow hold also if one replaces the term 
derivative by derivative number. See Lebesgue, Legons sur Vintégration, p. 121, 


et seq. 
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This result follows at once from the fact that under the conditions 
stated the derived function f’(x) is point-wise discontinuous. 


Cor. 2. If f(x) is continuous and has a derivative at every point of 
an interval (a, b), then f’(x) ts a function of at most Baire’s class one. 


This conclusion follows from the fact that f’(x) is at most a point- 
wise discontinuous function and is the limit as Az approaches zero 
of the difference quotient ee 

Ba A 
Ax 


which is continuous in x for Az different from zero. 


From the foregoing theorem, it also follows that if f’(#) exists at 
every point of a given interval, then it can not become infinite at a 
set of points everywhere dense. If f(x) is not a constant in a given 
interval, then f’(x) can not be zero at every point, and moreover it 
follows that it can not be exclusively zero or infinite at all the points 
of the interval; for, in that case it would not be point-wise discon- 
tinuous. 

As a condition for the continuity of f’(x), we have the following 
theorem. 

THEOREM IV. If f(x) ts continuous and has a derivative at every 
point in a closed interval (a, b) a necessary and sufficient condition that 
f' (x) ts continuous in (a, b) is that the difference quotient 


f(z + Az) — f(x) 
Ax 
converges uniformly. 


That the condition is sufficient follows at once from Theorem [X 
of Art. 26. For, putting as before 


Fle, Ag) = 


we have a function F(x, Ax) of the independent variables x and Az 
satisfying the conditions of that theorem. Hence the limiting 
function f’(x) is continuous in the given interval. 

The given condition is also necessary. For, from the Law of the 
Mean, we have 


F(a, Az) =f'@ + 0aey, Oe C= 1 (1) 


As the limiting function f’(x) is continuous in the closed interval 
(a, 6), it is uniformly continuous in that interval. Hence, for a - 
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given ¢€ there exists a 6 independent of x such that for every value 
Xo in (a, b) we have 
I f’(@) -—f'(ao) |< €, |e —a| < 6. 

Replacing x by x + @Az, this inequality becomes 

| f(a + OAx) — f'(a) | <e, 
which holds for every x and for all values of Az such that 

|x + OAx —a%| < 6. 

It is therefore valid for 


Jz-m| <3 |Az| <2 


a 
In other words, we have 


L f'(a + 0Az) = f’(a). 


I—X 
Azo 
From (1) it then follows that for every 2 in the closed interval (a, b) 
we have eG F(z, Az) = f'(a), 
Ao. 


and hence from Theorem VII, Art. 26 the difference quotient F(a, Az) 
converges uniformly to its limiting function f’(x). 


THeoreEeM V. Let f(x) be continuous in the closed interval (a, b) and 
have a derivative at each point in the deleted neighborhood of xo, where 
a<2<b. Then, if L f'(x) exists, the derivative f'(xo) exists and 


rt 2Xo 


f'(ao) = Lf’). 


Let Az be so chosen that 2) and 2 + Az both fall within (a, b). 
By the Law of the Mean, we have 


f(®o + Ax) — f(%o) = f' (a + 6Az), Ore Reel: (1) 


Az 


But by hypothesis f’(z) has a limit as x approaches 2, and hence 
L f'( + Anz) = A; 
Az-0 
Consequently, the left-hand member of (1) must also approach the 
limiting value A as Az approaches zero. Hence, f(x) has a deriva- 


tive at 2 and we may write ( Ale 
races f(%o + Ax) — f(%o) _ 
PO shies Ac ae 


and the theorem is established. 
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The discussions of this article would not be complete without men- 
tioning some of the properties of derivative numbers. Among these 
properties we have those given in the following theorems. 


TuroreM VI. If, in the interval (a,b), M and m denote respectively 
the least upper bound and the greatest lower bound of any one of the four 
derivative numbers of the continuous function f(x), it follows that 


ns 110) . 

We shall demonstrate the Fi be for the case of the upper right- 
hand derivative number, D*f(x). A similar proof holds for the other 
derivative numbers. To establish the second inequality in the 
theorem, it is sufficient to show that there exist values of D*f(x) at 


least as large as 22 — LO) — fo) f(a) 


Let P and Q ee the points on the curve y = f(x) corresponding 
respectively to z = a,x = b. If there are points on the curve above 
the line PQ, let P’Q’ be a 
straight line parallel to PQ and 
cutting the given curve at points 
Q whose ordinates are greater than 

those of P and Q. In this case 

it is always possible to find some 
point A of intersection at which 
xx the value of D*f(x) is at least 
equal to the tangent of the angle 
which PQ makes with the X-axis. 

If the given curve has no points above PQ but points lying below, 
it is always possible to find a line parallel to PQ and lying below it so 
that the same condition holds at some point common to the given 
curve and the straight line. f0) = fle = He 


A similar proof shows that 
greater than m. If the given ate y= ~ f(a) coincides with PQ, the 
required property follows at once. 


Q 


1G BPS 


must be equal to or be 


TueoreM VII. For continuous functions, the four derivative num- 
bers all have the same least upper bound and the same greatest lower 
bound in a given interval, and these upper and lower bounds are also the 
least upper and greatest lower bounds of the difference quotient 

f(a) — (2) | 
ty — Xo 
where x, x2 take all possible values in the given interval. 
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We shall establish the theorem for the derivative numbers D_f(z) 
and D*f(x). A similar proof holds for other possible cases and may 
be readily supplied. 

Denote the least upper bound of D+f(zx) in a given interval (a, b) by 
M. It follows from the previous theorem that the difference quotient 


f(8) — f(@) 

B-a ’ 
can not exceed M, where a and § are points in the given interval. 
We can, however, so select a and 6 that this difference quotient shall 
be larger than M-e, where ¢ is arbitrarily small. The least upper 
bound of D_f(x) in such an interval (a, 8), and hence in (a, b), is 
also at least equal to M-e. As the values of D_f(x) can not exceed 
the least upper bound of the difference quotient, it follows that the 
two derivative numbers D*f(x), D_f(x) and the difference quotient 
have the same least upper bound MM in the interval (a, b). A corre- 
sponding argument shows that D*f(x), D_f(x) have also the same 

greatest lower bounds. 

The following corollaries follow at once from the foregoing theorem. 


Cor. 1. If one of the derivative numbers of a continuous function 
has a positive lower bound, then the function 1s monotone and increasing. 

Cor. 2. If one of the derivative numbers of a continuous function 
has a negative upper bound, then the function 1s monotone and de- 
creasing. 

Cor. 3. If f(x) ts continuous and has a derivative at each point, 
then the least upper and greatest lower bounds of the derivative f'(x) in 
any interval are the same as those of the difference quotient. 

f(&2) — f(r) ; 
Le — Ly 

This corollary follows at once as a consequence of the foregoing 
theorem, since if f’(x) exists at all points of a given interval, it must 
be identical in value with the derivative numbers of f(x) for that in- 
terval. 

If all four of the derivative numbers are bounded, then we have 
the following condition 

f(a) — f(z») 
my — Le 
where M is finite and 2, 22 are any two points in the given interval. 
This condition is often spoken of as the Lipschitz condition. 


<.M, 
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TuroreM VIII. Lf a continuous function f(x) has a derivative 
number which is continuous at xo, then all of the derivative numbers are 
continuous at x» and f(x) has a derivative at that point. 


If one of the derivative numbers, say D*f(x), is continuous at Zo, 
then it must take at this point its maximum value, and this value 
must also be its minimum value at x. By Theorem VII all the 
derivative numbers have in any interval the same upper bound and 
the same lower bound. Suppose the interval in question to con- 
tain 2 as an inner point. As the length of the interval approaches 
zero, this upper bound approaches the maximum value of the deriva- 
tive numbers at 2. In a similar manner the lower bound approaches 
the common minimum value of the derivative numbers at 2%. How- 
ever, these values must be the same, since they are equal to those of 
D*f(x) and, as we have seen, the maximum and the minimum values 
of this derivative number are identical because of its continuity. 
As all of the derivative numbers take the same value at 2p, it follows 
that the derivative of f(x) exists at that point. 

It follows from this theorem that if one of the derivative numbers 
of a continuous function is zero for all values of x in a given interval, 
then the function has a derivative everywhere equal to zero and, 
hence, the function is a constant. 

The converse of this theorem is not true; that is, a function may 
have a derivative at every point of an interval and yet the derivative 
numbers may not be continuous. For example, let 


f(z) = 22-sin “2 £0, 
= 0 ee. 


The function has a derivative at every point in the interval (0, 1), 
namely , 1 1 
Oy en = 
f'(#) # sin - cos x # 0, 
= 0 et =): 
However, none of the derivative numbers are continuous at x = 0, 
since they must all be equal to the derivative at any point and the 
derivative is discontinuous at the origin. 
THroREM IX. A function is determined except as to an additive 


constant if we know a finite derivative number of the function for all 
values of the variable. 


* See DuBois-Reymond, Math. Annalen, Vol. 16 (1880), p. 128. 
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This theorem is equivalent to saying that any two functions 
fi(x) and f2(x) which have the same finite derivative number for each 
value of the variable can differ at most by an additive constant. 
Let us assume, for example, that at each point of the given interval 
these two functions have the same upper right-hand derivative num- 
ber; that is, that we have 


D*fi(x) = D*f2(z). (2) 
From the geometric significance of derivative numbers, it follows 
h 
aS D4[- fa(z)] = - D*fx(a). (3) 


From the definition of derivative numbers, we also have 
Dl file) — fe(x)] = D*fi@) + Dsl - fo(z)] S D*Lfi(x) — fo(z)]. 
From (2) and (38) the middle term is zero and hence 
DA f(x) — folx)] = 0s D*Lfi@) — fola)]. 


It follows that the two right-hand derivative numbers of the function 


F(x) = LA) — fox) ], 


if different from zero, can never have the same sign for any value of z. 
The function F(x) can then never increase nor decrease and conse- 
quently must be a constant. If the two right-hand derivative num- 
bers of F(z) are zero, then again F(x) is a constant. Hence, we have 


in either case fila) = fe(x) +. 


As to the case where the given derivative number becomes infi- 
nite, the foregoing theorem gives no information. In this respect 
the statement corresponds to that which may be made concerning a 
derivative; that is, we can say that two functions having the same 
finite derivative can differ only by an additive constant, but. if the 
condition of finiteness is omitted, no such statement can be made. 

The foregoing theorem has been generalized by Scheeffer ! in that 
he has shown that a continuous function is determined except as to 
an additive constant if one knows for each value of x, except at most 
for an enumerable set of points H, a finite derivative number of the 
given function. As a consequence it follows that a continuous function 
is determined as soon as one knows that its derivative, or a deriva- 
tive number, at the irrational points exists and is finite. Moreover, 


1 See Acta Math., Vol. 5 (1884-5), pp. 282-283. 
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it also follows that any two functions can differ at most by an 
additive constant if they have the same finite derivative number for 
all values of the variable with the exception of an enumerable set. 

32. Definition of partial derivatives. Suppose we have given a 
function z = f(z, y) of the two independent variables x and y. If we 
regard x as a constant, then f(x, y) may have a derivative with respect 
to y, which we call the partial derivative with respect to y and denote 


it symbolically by af 
oy ty (x, y)- 
For the point (xo, yo), such a partial derivative is defined by the limit 
f(@o, yo + Ay) = f(ao, Yo) 
Te Ee eee 
(ee Ay (1) 


Similarly, holding y constant we have the partial derivative with 
respect to x, represented symbolically by 


Of pi 
ax fe (a, y), 


and defined at the point (20, yo) by the limit 


f(xo + Ax, yo) — f(Xo, Yo) 
Sen Ax (2) 
The derivative functions f, (2, y), f,/(x, y) are in general functions of 
x and of y and hence may themselves have partial derivatives with 
respect to either z, or y. We are thus led to the higher partial deriv- 
atives af af if of 
dx? dy? dydx dxdy 


» etc. 


As in the case of the partial derivatives of the first order, the deriva- 
tives of the second order may be defined by means of limits as follows. 


Of eg p fe (Xo + Ax, Yo) — f2 (Xo, Yo) 


Of? Ago Az 
ie, T f(tot+Arzt+Aox, yo) — f(t Aix, yo) — f(xot+Art, Yo) + f (xo, Yo) 
Air 0 A,rz-0 Ayr - Asx 
f(x + 2Az, Yo) ae 2f (xo + Az, Yo) + f (Xo, Yo) 4d 7 
= ree Lor 2 ~=X, (If f2 (Xo, yo) exists). (3) 
Of _ 7, fu (®o yo + Ay) = fu (Xo, Yo) 
Oy Ay-0 Ay 
aes Ts F (0, YotAryt+Ary) — f(@o, yotAw) — f(t, yor Ary) +f (royo) 
Ayy-0 Az—-0 Ay Ay 


; f (0, Yo + 2ZAy) — 2F (xo, yo + Ay) + F(xo, Yo) 


. Ay—0 (Ay)? » ffi (Xo, Yo) exists). (4) 
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O°f =a fz (Xo, Yo + Ay) — fz (Xo, Yo) 


OyOx Ay-0 Ay 
ay, o f(eot Ax, yotAy) — f(aot+Az, yo) — f(xo, yotAy) + f(®oyYo). 5) 
Ay-0 Az0 Ay Az ( 
Of a Ve fi (Xo “5 aXe Yo) = fy: (Xp, Yo) 
Oxdy Ar—0 Az 
ee & Z f(tot Az, yotAy)—f(tot+ Ax, yo)—f(2o, yotAy) +f(Zo, Yo) : (6) 
Ar0 Ay>0 Ay Az 


From these definitions, it will be seen that any discussion of the 
properties of these derivatives involves iterated limits as well as single 
limits. Corresponding definitions for other higher derivatives may 
be readily formulated. 

In this connection it must be pointed out that the existence of the 
higher derivatives implies the existence of the corresponding deriva- 
tives of lower order. Thus in order that f// should exist at a point 
it is necessary that the partial derivative f, should exist in the 
neighborhood of that point. It is possible, however, for the limit 
defining f/z to exist without the partial derivative f/ existing as the 
following illustration shows. In such a case the higher derivative 
can not be said to exist. 


Ex. 1. Given f(z, y) = x sin + +y sin 7 xz #0, y £0, where f(0, y) = y sin ” 
y £0; f(z, 0) = zsin * xz £0; f(0,0) =0. Examine the existence of f,/ and f/z 
ab te Ong — (); 


’ ir f(Az, 0) — f(0, 0) _ sae bi 
We have f,'(0, 0) = - Ls ‘ 8 = eae sin 7; 


Since this last limit does not exist, the derivative f/(0, 0) can not be said to exist. 
However, the limit used in defining the second derivative fz does exist, for we 


we 1 Lhe Av) = s(A2, 0) = $0, Av) + f00, 0) 
Ay-0 Az—0 An Dy 


feed Pah gil ra! Pm | 
sr Assn 7, + Ay sin 7, — Avsin 7, Aysin 7 
Ay-0 Az-0 Ax Ay 


= Lb L 0=0. 
Ay-0 Az—-0 


In spite of the fact that this limit is zero, the derivative fyz(0, 0) can not be 
said to exist, since f,’(0, 0) does not exist. 


33. Properties of partial derivatives. If the two partial deriva- 
tives f7, f, exist and are finite at every point in a given region R, it 
then follows that f(z, y) is continuous in x and in y in this region. 


ie DERIVATIVES AND THEIR PROPERTIES  ([Cuap. IV 


Consequently, f(z, y) must be continuous with respect to x and y 
together at a set of points everywhere dense in R. That the existence 
of these two derivatives is not a sufficient condition that f(z, y) is 
everywhere continuous in (x, y) is shown by the following illustration. 


Ex. 1. Given the function f(x, y) = a » for «#0, y #0, and let 


f(0,0) =0. Show that the partial derivatives f/, f,’ exist everywhere in the 
region —-1 <a <1, —-1 Sy <1, although f(z, y) is discontinuous in (Ge, Op) 
at the origin. 

For « #0, y #0, we have 


ese , y a. oe [alae a5 a y’ 
Sa = 2ay (xt + yy? Up (at + yy? 
For z = 0, y = 0, we obtain 
(Az) -0 1 0O-Ay 

—— ——_— -0,f,= L 

f Az>0 (Ax)4 +0 ty Ayo Ay 0 + (Ay)? 
Similarly, from the definitions of the last article, we have 

/ Lt / / 1 
fe (0, y) = fz (2, 0) =0, fy (0, y) =0, fy (a, 0) 7 


Consequently, the partial derivatives f,’, f,/ exist at all points of the given region. 
The function f(z, y) is not continuous in (z, y) at the origin as one sees by com- 
paring the limiting values along the line y = 0, and along the curve y = x”; for, 
in the first case we obtain the limiting value 0 and in the other case 3. 


The following theorem gives a sufficient condition for the conti- 
nuity of the given function. 


TuHrorEeM I. If f2, fj both exist and are finite at each point of a 
given region and if one of these derwatives is bounded as to (a, y), then 
f(x, y) ts continuous in (x, y). 


Since both f/ and f, exist and are finite, it follows that f(z, y) is 
continuous in # and in y at every point of the given region. By 
hypothesis one of the given derivatives, say f,/, is bounded for all 
values of x and yin the given region R. Let yo be any value of y in 
k. From the continuity of f(x, y) with respect to y, we have for 


any value of xin R is Ss 
L_ f(z, v) =f, w). 


For all values of y ¥ yo and for all values of x, we have 
| f(a, y) |< M, 


where M is some finite number. Hence, from Theorem VIII, Art. 26, 
it follows that f(x, y) converges uniformly to f(z, yo). A necessary 
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and sufficient condition for the uniform convergence of a function 
f(x, y) which is continuous in z is that 


L f(a, y) = f(2o, Yo)s 
yu 
where 2% is any point on the line y = yo and lying in R. But yw is 
any value of y in R; hence, this simultaneous limit exists for any 
point (Xo, yo) in R, and f(x, y) is therefore continuous in (x, y) as the 
theorem states. 
We may state the following corollary of the above theorem. 


Cor. If the partial derivatives f/, f/ exist and are continuous in 
(x, y) in the neighborhood of (xo, yo), then f(x, y) is continuous in (x, y) 
at (Xo, Yo)+ 


This proposition follows as a consequence of the foregoing theorem; 
for, since the partial derivatives are continuous in (z, y) in the neigh- 
borhood of (xo, yo) there must exist about this point a closed region 
in which these derivatives are bounded in the two variables to- 
gether. Hence, in the neighborhood of (a, yo) the conditions of the 
theorem are satisfied. 

For convenience in the discussion of the theoreins to follow, let us 
set up the auxiliary function F(a, y, Az) defined as follows. On the 
line y = yo consider the closed interval (2 — 6, 2% + 6). In this 
interval take any two points « and x + Az such that in case x ¥ 2% 
they lie on opposite sides of x. Let us assume that f(z, y) is continu- 
ous in x and in y and that for every value of x the partial derivative 
fi exists. We then put 


F(a, yo, Ax) = HE + Ot, Yo) =H, 8, Az 52 0, 


Let the value of F(x, yo, 0) be defined by the relation 


f(to + Ax, yo) — f(x; Yo) soe 


F (Xo, Yo, 0) = noe IE (0, Yo) 


We shall now consider the oscillation of F(x, y, Av) in the neighbor- 
hood of (20, yo). If M and m denote respectively the least upper 
bound and the greatest lower bound of F(z, y, Az) in this neighbor- 
hood, then the oscillation w is given by the relation 


w= M—m. 
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It will be noted that w varies with 6 and indeed as 6 increases w 
never decreases, while for decreasing 6 we have 


L w(6) = 0; 
6-0 


for, as 6 approaches zero Az also approaches zero, and we have the 
same limiting values for M and m, namely f7 (ao, y). 

For a given value of w, say w = 7, there exists for the point (%o, yo) 
a definite interval on the line y = yo, namely 


{Xo a 6(xo, Yo); Lo + 6(xo, yo)}, 


where 6(2o, yo) depends upon the point (%o, yo) and is to be considered 
as the least upper bound of those values of 6 for which the value 
of w is equal to or less than 7. We may now prove the following 
theorem.! 


TueoreM II. For a given value of o there exists a neighborhood 
(t — 0,2 +0; Yo—F,Yo+) of the point (Xo, yo) in which d(x, y) 
1s an upper semi-continuous function; that is, 

d(x, y) we 6 (ao, Yo) + €, 
where € is an arbitrarily small positive number. 

By hypothesis the value of the oscillation w in the interval 
{xo— (Xo, Yo), Zo + 6(2o0, yo) } taken on the line y = yois a given number 
n. If the interval is increased by ¢ in length by replacing 6(2, yo) 


by (20, yo) + 5 we then have an interval 


 — 5(a, yo) — $a + 8(2, 0) + ‘| 


in which the value of w is greater than 7, say equal to 7 + a. Hence, 
we can select two points 2; and 2, distinct from 2, in the ee + 


interval and two values of Az such that 0<|Az|<6(xo, yo) + . say 
Ayz and Ax, for which we have 


| F(x, Yo; Az) as F (ts, Yo, Asx) | oe 0 Og, (1) 
where a, <a. One of the points 2; + Aix, rz + Aor, say x, + Aja, 
must lie exterior to the interval {x — 8(o, yo), 2 + 6(20, yo)}, while 


the other may be interior to this interval. Let (a — y, 20 + Y) 
be an interval on y = yo such that all of the points a, x2, 2; + Ai, 


1 Cf. Baire, Annali di Mat. series III#, Vol. III (1899), p. 105. 
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az, + Asx lie exterior to it. As F(a, y, Az) is continuous in Yat 
follows that for any value of y sufficiently close to yo, say such that 
|y — yo| < B, we have from (1) 


| F(a, y, Ai) — F(ae, y, Aor) | > 7. (2) 

Denote by o the smallest of the three numbers 8, y, : and consider 
the points (x, y) within the square defined by the inequalities 

M-T<T<KHM+Oyw-T<y<wtres. (3) 

Through any such point draw a line L parallel to the X-axis, and 

upon this line take the interval to — 0(%o, Yo) — 5 xo + 6(o, Yo) +5 . 


Whatever value of y is chosen, this interval contains the four points 
(m1, y), (2, y), (xy 2B Az, Y), (2 ate Asx, Y), (4) 


and hence from (2) the value of w in this interval must be greater 
than 7. To each point (2, y) there corresponds a definite 6 such that 
on the line Z there exists an interval (x — 6, x + 6) in which w is 
less than 7. 

Denote by 6(x, y) the least upper bound of all those values of 6 
for which the inequalities (3) hold. We must then have 


6(x, y) st 6(xo, Yo) Es €; 


for, otherwise the interval (x — 6, x + 6) would contain the points 
(4) and hence w could not be less than 7. Hence, 6(«, y) is upper 
semi-continuous. 

In case of functions of a single variable, it was shown that the 
derivative f’(z) is at most point-wise discontinuous. The corre- 
sponding theorem with respect to the partial derivatives of f(z, y) 
can be stated as follows. 


TueEoreM III. Given a function f(x, y) which ts continuous in x 
and in y. If the partial derivative fz (or fy) exists at every point in a 
given closed region R, then it is at most point-wise discontinuous in (2, y). 


The value of 6(z, y) in general depends upon the choice of 7, where 
these symbols are used as defined in the foregoing discussion. By 
Theorem II, 6(z, y) is an upper semi-continuous function of (a, y). 
It follows, as in the discussion of uniform continuity, that within 
any given closed region there exists a subregion in which the greatest 
lower bound of 6 is positive, however small 7 may be chosen. Hence, 
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there exist in any given closed region points where 6 has this greatest 
lower bound however small the oscillation of F(a, y, Av) and con- 
sequently of f2(x, y) may be. 

Let R be any region in which the greatest lower bound of 6(z, y) is 
6, > 0. We shall now show that at any point Po = (20, yo) of this 
region the oscillation of f(x, y) with respect to x and y together is 
never greater than 27. Denote by &; a rectangle lying within R&R 
and so chosen that it contains the point Po and its sides are parallel 
to the axes of codrdinates, the dimension parallel to the X-axis be- 
ing less than 6,. On the line y = yo select two points Ao = (29, yo), 
Bo = (2, + Az, yo) lying within R, but on opposite sides of Po. From 
the existence of f/ (a, y) at Po, we have 

| F(Zo, yo, Ax) — fz(%o, yo) | = 7. (5) 

Through Ao, Bo draw two lines L1,L 2 parallel to the Y-axis. On each 
of these lines select an arbitrarily small interval inclosing the points 
Ao, Bo, respectively. Let L be a line parallel to the X-axis and suf- 
ficiently close to y = yo so that it intersects Li, L2 within the above 
intervals. Let A = (%, y), B = (% + Az, y) be the points of intersec- 
tion. Because of the continuity of f(x, y) in y, we have 


| F (Zo, Y; Ax) a F (Xo, Yo; Az) | = é, (6) 


where € is an arbitrarily small, positive number. Let P be any point 
on the line L between A and B. We have then an arbitrarily small 
area about Po but containing the point P, such that we have, since 
f2z(«, y) exists at P, for all values of y lying in this area 


GEC? y) -s F (Xo, Y; Az) | s 7). (7) 
Upon combining (5), (6) and (7), we have 
fe (a, y) — fz (2, Yo) | = 2n sige 


However, (20, yo) was any point of R. As we have seen, there 
exist points in every region R for which 6(2, y) has its positive lower 
bound, however small 7 may be chosen. At every such point the 
uscillation of f(x, y) must be less than the arbitrarily small choice 
of 2n+e, and hence f,'(x, y) must be continuous. As such points occur 
in every region, the points of continuity of f(a, y) are everywhere 
dense, and consequently it can be at most apace discontinuous in 
(x, y), as the theorem states. 

In a similar manner, it may be shown that f(x, y) is at most 
point-wise Bieeantimucgs: 
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34. Total differentiability. Suppose we have given a single- 
valued function z = f(x, y) defined for a region R given by the in- 
equalities 

Ure an DC <<. 


We shall inquire into the conditions under which we may express the 
total differential of the function f(x, y) by means of the relation 


dz = os dx a of ape (1) 


or what is the same thing, what conditions if any must be placed 


Of of. 


upon the partial derivatives ax’ ay in order that this relation shall 


constitute a satisfactory definition of such a differential. In order 
that the definition be satisfactory, it must be such that when we 
assume a relation between the variables x and y, say 


y = o(2), (2) 
» or if we express each variable in terms of a parameter, say 
c= lt), y = ¥2(0), (3) 


we may find by aid of (1) the total derivatives of z with respect to 
x and with respect to t, namely: 


dz of , of. dy 
dx ox oy dx 
G2) sOl ev. Oo}, 2 Oy. 


di dn di * Oy dt ©) 


(4) 


Moreover, we should be able to get the same numerical value of 


& by the use of (4) as by differentiating directly with respect to x the 
a 


transformed function , _ F(x) = fia, o(z)}. 


That this is not always true if we assume in (1) merely the exist- 
ence of the partial derivatives f7, f,/ is illustrated by the following 
example. 


Ex. 1. Given z =f(z, y) = for z ~ 0, y ¥ 0; and let f(0, 0) = 


aa a xg 
The partial derivatives f/(0, 0), f,/(0, 0) both exist, each being equal to zero. 


ssume 
If we now a ec Oae 
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as the curve along which we propose to restrict the variation of x and y, we have 
from (4), for xz =0, y =0, 

de _ Of of dy 

dx Ox Oy dx 


On the other hand, putting y = z in the given function, we have 
ay 
(a 34a f0na) = 0, 


= 0, forg =90, 
whence we have for x = 0 


CPC OOM, ie 


dx Az—30 Ax Apo Ae 3 pee oe 

Likewise, if we transform the given function by means of the re- 
lations given in (8), it does not necessarily follow that we get the 
same numerical value by differentiating the transformed function 
with respect to ¢ as is obtained from the given function by use of (5), 
if no restrictions as to continuity are placed upon f,, f,/, as the fol- 
lowing example shows. 

Ex. 2. Given! z = V] zy] 

The partial derivatives f, (0, 0), f,/(0, 0) exist; for, we have 


ECM v 


' f(Az, 0 
AOOy ea L mabey 
f2(0, 0) Az—0 Az Az30 Az 


, f(0, Ay) — f(0, 0) 0 
00) =. 2 Se eee So 
ON Ay0 Ay Ayo Ay 


Hence, (5) gives —=0-—+0-— = 0. 


On the other hand, if we transform the given functions by the relations 


c=) =t, y=ynlt) =1, (6) 
we have z=vV/ OW |=Ve=t, 
and hence S = 


Consequently, the relation (1) can not be said to give the total differential, since 
it does not give the proper value of the total derivative along the curve (6). 


These illustrations show that any statement of the condition for 
total differentiability which involves merely the existence of the 
partial derivatives f,, f/ is not sufficient; for, under any such con- 
ditions the relations (1), (2), (3) are not necessarily consistent. 


1 See Stolz, Differential = und Integralrechnung, p. 133. 
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For the purposes of elementary analysis it is sufficient, however, 
and often convenient to assume that these partial derivatives are 
continuous with respect to the two variables (a, y) together. This 
assumption enables us to show by aid of the Law of the Mean the 
existence of the total differential as given by (1) and consequently 
the total derivatives in a particular direction as given by: (4) and (5). 
As we shall see later, such an assumption as to continuity is broader 
than it need be. 

A suitable condition for total differentiability may be set up by 
following the analogous condition for differentiability of a function of 
a single variable. The function f(x) is differentiable at x» if there 
exists a number A such that we have 


L f(eo + Ax) — fim) — A- Ar 


0. 
Az—0 Az 


Here, | Ar| is the distance between the fixed point 2» and the 
variable point x) + Az. For the case of two variables the dis- 
tance between the fixed point (2%, yo) and the variable point 
(to + Ax, yo + Ay) is V(Az)? + (Ay)?, which may be regarded as the 
simultaneous increment of the two variables and denoted briefly by 
A(z, y). The corresponding increment of the given function is then 
f(@o + Az, yo + Ay) — f(x, yo). The function f(x, y) may then be 
said to be totally differentiable if there exist two numbers A and B 
such that we have the simultaneous double limit 


L f(to + Az, yo + Ay) — f(xo, yo) — A-Ax — BAy aT; 


a A(x, y) 


This form of the condition for total differentiability is that intro- 
duced by several writers.!. As Fréchet points out, one might make 
use of what he calls the écart, namely | Az | + | Ay |, instead of the 
distance function A(z, y) employed in the foregoing definition. 

If the given function is totally differentiable, it follows from this 
definition that the partial derivatives f7 and f, exist and are finite; 
for, putting Ax equal to zero and passing to the limit as Ay ap- 
proaches zero, we see that B is nothing else than the partial derivative 


1 See Fréchet Nouvelles Annales de Math. (1912), Vol. 71, p. 389; also Ko- 


walewski, Komplexen Verdnderlichen (1911), p. 186. 
A similar definition was also made by Thomae as early as 1875 in his Theorie der 


Bestimmten Integrale, p. 37. 
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f/ (xo, yo). Likewise, putting Ay equal to zero and passing to the 
limit, we see that A is the partial derivative f, (xo, yo). Hence 
the above definition may be written 


V6; f(ao+Az, yot Ay) —f (Xo, yo) —Ax fz (&o; Yo) —Ay ja ie Yo) =() (7) 
mee A(z, y) 


Ay-0 


The reason why the numerical result obtained from equations 
(4) and (5), when we assume merely the existence of the partial 
derivatives fz, f,, does not always agree with the derivative obtained 
from the transformed function is readily seen from geometric con- 
siderations. The partial derivatives f7(xo, yo), fy (Xo, yo) determine 
the slope of two tangent lines, lying respectively in planes parallel to 
the (X, Z)-coérdinate plane and the (Y, Z)-codrdinate plane, with 
respect to the projection of these lines upon the (X, Y)-plane. 
These two tangent lines determine a plane passing through the point 
(20, Yo, 20). On the other hand, if we assume a relation between x 
and y, say those given by (2) or (3), and take the derivative of the 
corresponding transformed function we get the limiting position of a 
tangent line to the surface z = f(x, y) as the point of tangency ap- 
proaches (%o, Yo, 20) along the curve corresponding to the assumed 
relation between x and y. This tangent line may or may not lie in the 
plane through (ao, yo, 0) determined by fz(2o, Yo), fy (Xo, yo). This 
interpretation of the two results suggests a condition for the existence 
of total differentiability which may be stated as follows. 


TuroreM I. A necessary and sufficient condition that the function 
f(x, y) is totally differentiable at (xo, yo) is that the surface z = f(z, y) 
has a tangent plane at the point (Xo, Yo, 20) which is not parallel to the 
Z-axis. 


To show that this condition is necessary, we assume that the given 
function is totally differentiable at (a, yo). Hence, the partial 
derivatives f, (Xo, yo), fy (Xo, Yo) exist and are finite. If we take any 
curve on the surface such that it passes through the point (xo, Yo, Zo) 
and has at this point a definite direction, then this curve has at that 
point a definite tangent, which is also tangent to the surface. If we 
can now show that all such tangents at (2o, yo, 20) lie in the plane de- 
termined by the tangents parallel respectively to the (X, Z)-plane and 
the (Y, Z)-plane, then that plane is the tangent plane at (ao, yo, 20). 


1 Cf. Fréchet, Nouvelles Annales de Math. (1912), Vol. 71, p. 436. 
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The tangent to a curve cut from the given surface by the plane 
y = yo is a line parallel to the (X, Z)-plane and is given by the equa: 


tions 
Y = Yo, 2 — % = (X — 2X) fe (Xo, Yo): 


The direction cosines of this tangent are therefore proportional to 
‘ 0, Fe (o, Yo). 


Similarly, the tangent line parallel to the ( Y, Z)-plane is given by the 


equations 
2 %= XM, 2-4 = C = Yo) Fy (Be, Yo)s 


and its direction cosines are proportional to 


0, fy (Xo, Yo). 
The equation of the plane determined by these tangents is, therefore, 


Coty Y= Yo eo ee 
1 0 F220, Yo) | = 0% 
0 1 fy (Xo, Yo) 


that is, (2 — 2) — (y — yo) fy (Zo, Yo) — (& — 40) fe(ao, yo) = 0. (8) 


To obtain the equation of a tangent line to the surface at 
(x0, Yo, 20), let us assume a second point (x + Az, yo + Ay, 29 + Az) 
on the surface. The chord connecting these two points becomes in 
the limit, as Ar, Ay, Az approach zero, a tangent line to the surface. 
The direction cosines, cos A, cos w, cos vy, of the chord are respec- 
tively proportional to 


Az Ay Az : 
Van)? + (Ay? =-V(Az)? + (Ay? = -V(Az)? + yy? 


in fact, these expressions multiplied by sin v are the direction cosines. 
Upon passing to the limit, we have three numbers which are propor- 
tional to the direction cosines of a tangent line L to the surface at 
(20, Yo, 20). As we shall see, these limiting values may be written 


cos a, cos 8, cos a f/ (Xo, Yo) + cos B fy (Xo, Yo), 


where a, 8 are the direction angles of the projection of L on the 
(X, Y)-plane. For, if the direction angles of the projection of L are 
a, 8 respectively, then from (7) we have 
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L Seo + Az, yo + Ay) — f(Xo, Yo) 
Az—0 A(x, y) 


Ay-0 
( Az Ay 
= Aaa A(a, y) oF (ao, 2 Yo) + ———~ A(z, y) ye (Xo, w)} 


Ay-0 
= cos a: fz (Xo, Yo) + COS at (0, Yo). (9) 


The equations of the tangent may then be written in the form 


lee ma! Lome Ea & — 0 (10) 


cos @ cosB cos @- fz (Xo, Yo) + COS B- fy (Xo, 4 Yo) 


Replacing x — xo, y — Yo, 2 — 20 in (8) by the numbers which by (10) 
are proportional to them, we see that (8) is satisfied, no matter what 
may be the values of a, 8. Hence, the tangent at (2, Yo, 20) lies in 
the plane determined by the tangents to the given surface at this 
point which are parallel respectively to the (X, Z) and ( Y, Z)-planes. 
This plane is then a tangent plane to the given surface. Moreover, 
since fy (20, Yo), f,/(%o, Yo) are both finite, it follows that this plane 
can not be parallel to the Z-axis. 

We can show as follows that the condition given in the theorem is 
also sufficient for total differentiability. Assuming that the surface 
z = f(z, y) has a tangent plane at (Xo, Yo, 20), we have for its equation 


2 — 2 = (Y — Yo) fy (Xo, Yo) + (X — Xo) fz (Xo, Yo), (11) 
where (x, y, 2) are the coérdinates of a variable point P’ on that plane. 


Replacing (x — 2), (y — yo), (2 — 20) by Az, Ay, Az, respectively, we 
may write the foregoing equation in the form 


Az a Az fz (Xo, Yo) ST Ay fy (Xo, Yo), 


where Az denotes the length of the perpendicular let fall from P’ 
upon the plane S which passes through the point Q@ = (,-yo, 20) and 
is parallel to the (X, Y)-plane. The foot of this perpendicular is 
P = (a + Az, yo + Ay, 20). Denote by Af the distance on this same 
perpendicular, extended if need be, measured from the point P’’ 
where it cuts the given surface to the plane S. We have then 


Af = f(xo + Ax, yo + Ay) — f(xo, yo); 
and hence 
Af — Az 
V (Ax)? + (Ay)? 
_Lo + Az, yo + Ay) —f(%o, yo) — Ax fz (x0, Yo) — Ay fi (xo, Yo) 
AG, y) iy jie 
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However, we may put 


Af = V (Az)? + (Ay)? tan gi, Az =V/(Az)? + (Ay)? tan do, 
where ¢;, ¢2 are the angles made respectively by the lines P’’Q, 
P’Q with PQ. Since the plane given by (11) is tangent to the sur- 
face, it follows that as P’’ approaches Q in any manner whatsoever; 
that is, as Ax, Ay approach zero simultaneously, $i, @2 and hence 
tan @;, tan d2 approach the same limiting value. Consequently, we 
have 


Af — Az 
L = L {tan ¢d, — tan de} = 0. 
ard (Any + (Ay? peg 
We have, therefore, from (12) 
L = yot+ Ay) —f (Zo Yo) —Axf, (Xo, yo) —Ayfy (xo; yo) \ = (0° 
Ayo A(z, y) a 


that is, the given function is totally differentiable at (%o, yo), as the 
theorem requires. 

By introducing polar coérdinates one may express analytically a 
necessary and sufficient condition for the existence of a total differ- 


ential. Put Ae p cos 6, Ay = sin 6. 


From (7) we then have 


: {f(zo+p cos8, yotp sin8) —f(xo, yo)} —cos8 fz (ao, yo) —sin8 fy (xo, Yo). 
A necessary and sufficient condition that (7) has the limit zero as 
Az, Ay approach zero simultaneously; that is, that f (x, y) is totally 
differentiable at (xo, yo), is that 

il : 

pit eo + pcos 8, yo + psin 8) — f(xo, yo) } 
converges uniformly in the closed interval (0, a) to the limit 

cos 8 fz (ao, yo) + sin 8 f,'(Xo, Yo) 
as p approaches zero. 
The definition of total differentiability given by (7) can now be 

expressed in the following equivalent form: 
flay + Ac, yo + Ay) = f(a, yo) + Ax fz (xo, yo) + Ay fy (0, Yo) 
where L E(&z, Ay) = 0. 


Az—0 
Ay-0 
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A definition somewhat similar in form is frequently employed. Any 
one of these equivalent definitions renders the relations given in 
(1), (4), and (5) consistent with one another and with the results 
obtained by first transforming the given function by means of an 
assumed relation between the variables and then computing the 
derivative from the resulting function. 

There is a certain advantage in the differential notation used in 
(1) to express the results of total differentiation. The relations 
expressed by (4) and (5) imply a knowledge of a relation between the 


; : ete - 
variables x and y; for, in (4) we have involved the derivative = 
and in (5) the derivatives cat oy, In other words, these relations 


give the results of differentiating in a given direction. On the other 
hand, the differential notation employed in (1) does not involve any 
condition as to direction. 

We shall now consider some of the consequences of total differen- 
tiability and also some of the conditions that must be placed upon the 
partial derivatives f7, f,/ in order that the function f(z, y) may be 
totally differentiable. 

As one of the consequences of total differentiability, we have the 
following theorem. 


TuHeEorREM II. Jf z=f(zx,y) is totally differentiable at the point 
(Xo, Yo), then the given function is continuous in (x, y) together at (Xo, Yo). 


This theorem follows at once from (7). In order that this limit 
shall be zero, it is necessary that the numerator shall have the limit 
zero. Since the last two terms in the numerator vanish as Ar, Ay 
approach zero, we have the condition that 


Ageig ta + At, yo + Ay) = f(x%o, yo); 

Ayo 
but this is the condition that f(z, y) is continuous in (2, y) together 
at (Xo, yo). Hence, the theorem follows. 

From the foregoing theorem it follows that continuity in the two 
variables is a necessary condition for total differentiability. It is 
not, however, a sufficient condition, as the following illustration 
shows. 

1 See Stolz, Grundzige der Differential = und Integralrechnung, Vol. I, p. 132; 
Pierpont, Functions of Real Variables, Vol. 1, p. 268: Young, Fundamental 


Theorems of Differential Calculus, p. 21; Encyclop. des Sci. Math., II 3, p. 287; 
Nouvelles Annales de Math., Vol. 71 (1912) p. 391. 
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Ex. 3. Given the function f(z, y) = oe 
f(0, 0) = 0. V (e+ y?) 

The given function is continuous in (2, y) at the origin; for, upon putting 
x=pcosv, y= psind, we have 


xY 


and this last expression converges uniformly to the value zero as p approaches 
the limiting value zero. But the given function is not totally differentiable at 
the origin; for, since f,’(0, 0) = 0, f,/(0, 0) = 0, we have 


L #(Az, Ay) — fO, 0) — Ax f(0, 0) — Ay fF,’ (0, 0) 
Az>0 A(@, y) 
Ay-0 
AxAy 1 L AxAy 


) aan 


Az-0/(Az)?+ (Ay)! ~V(Ax)?+ (Ay? 429 Az)? + (Ay)® 


for « #0, y ¥ 0, and let 


= pcos @ sin 0 = Sain 26, 


This last limit does not exist, as we can see by comparing it with Ex. 4, Art. 23. 


As we have seen in Art. 33, the existence of the partial derivatives 
f2 (Xo, Yo), fy (Xo, Yo) ensures the continuity of f(x, y) with respect to 
x and with respect to y, but not with respect to x and y together. 

The following theorem is a consequence of the definition set up for 
total differentiability and gives a sufficient although not a necessary 
condition for total differentiability. 

TueoremM III. If the partial derivatives fi/(x, y), f(a, y) exist 
at the point (Xo, yo) and if one of these derivatives exists for all values 
of x,y in the neighborhood of (xo, yo) and 1s continuous at that point 
in thetwo variables together, then f(x, y) is totally differentiable at (xo, yo). 


The first two terms in the numerator of (7) can be written in the 
form 
f(%o + Ax, yo + Ay) — f(ao + Ax, yo) + f(to + Ax, yo) — f(Xo, Yo). 


Since by hypothesis the derivative f7(a, y) exists at (Xo, yo), we have 
f(ao + Az, yo) — f(xo, yo) = Ax fr(o, yo) + Ax e(Az), 
where Ty e(Aa) = 0; 


Az—0 
We shall assume in accordance with the conditions of the theorem 
that f,/(z, y) exists for all values of « and y in the neighborhood of 
(xo, yo) and is continuous in (2, y) together at this point. By the 
Law of the Mean we then have 


f(to + Aa, yo + Ay) — f(to + Az, yo) = Ay f(a + Ax, yo + OAy) 
Ore Oral; 
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From the left-hand member of (7) we now have by aid of the fore- 
going relations 


Ay : ; 
ee: Fran fy(eo + Ax, yo + BAy) — fr (xo, Yo) } + 
Ax 


Ay-0 
ea e(Ax) | (14) 


Since f,/ (x, y) is continuous in (2, y) at (%o, yo), we have 


L [f/(®o + Az, yo + OAy)] = fr (Xo, Yo). 


Az—0 
Ay-0 
Moreover, for Ax#0, Ay0, we have 
Ax Ay 
Ac, | < 4 |R@, w|< 


Consequently, the limit given in (14) exists and is zero; that is, the 
condition of total differentiability is satisfied. Hence, the theorem. 

From this theorem it follows, of course, that a given function 
is totally differentiable if the two derivatives fz, f,/ are continuous in 
(x, y). This condition furnishes an easy and satisfactory test for the 
purposes of elementary analysis.) 

As we have seen, a function of a single variable may be continuous 
throughout an interval without having a derivative at any point of 
the given interval. Similarly, for functions of two independent 
variables it is possible for a function to be continuous with respect 
to both variables in a given region without being totally differentiable 
at any point of the given region. 

From Theorem III of Art. 33, it follows that if we assume merely 
that f,, f,/ exist, then each is continuous in (x, y) together at a set of 
points which is at least everywhere dense and has the cardinal number 
of the continuum. As a consequence, we have the following theorem. 


THEOREM IV. Given a function f(a, y) having the partial derivatives 
fz, fy for all values of (x, y) in the given region R. The points at which 
f(x, y) ts totally differentiable form a set which ts at least everywhere 
dense in R and has the cardinal number of the continuum. 


By the method of condensation of singularities to be considered 
in Chapter VII, it is possible, however, to set up a function which is 
totally differentiable at a set of points everywhere dense in the given 
region and at the same time fail to have a total differential at a set 
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of points also everywhere dense in the same region. Thus it could 
have a total differential at all of the points (x, y) where one or both 
the variables are irrational and fail to have this property where both 
are rational. It would not be possible, however, for the function to 
be totally differentiable merely at the points where both variables are 
rational. By aid of Theorem I this statement is equivalent to saying 
that if f7, f,/ exist at every point in R, then the surface 


z= f(x, y) 


must have a tangent plane not parallel to the Z-axis at a set of points 
everywhere dense in F&, but there may also exist a set of points every- 
where dense at which the surface has no such tangent plane. 

We have also the following theorem as a condition for total differ- 
entiability. 


THEOREM V. Given the function f(x, y) whose partial derivatives 
fd, fj exist at (xo, yo); then f(x, y) is totally differentiable at (xo, yo) 
af in the neighborhood of (xo, Yo), f(z, y) 78 continuous in y for x A Xo 
and the difference quotient 


f(ao + Ax, y) — f(xo, y) (15) 


Az 


converges uniformly as to Az for all values of y in that neighborhood. 


We set up the identity 
f(ao + Az, yo + Ay) — f(x, yo) hs f(ao + Ax, yo + Ay) — f(x, yo +Ay) 
A(z, y) A(z, y) 


S(t0, yo + Ay) —f(xo, Yo) 
. A(z, y) sales 


Since the partial derivative f,/(2o, yo) exists, we may write 


f(xo, Yo + ae ax S(£o, Yo) Pe fi (xo, Yo) 
Y 

or | f(xo, yo + Ay) — f(ao, yo) — Ay fy(t0, yo) | < €- | Ay]. (17) 

As the convergence of the difference quotient (15) is uniform for all 


values of y in the neighborhood of (ao, yo), it follows that for a given 
value of € there exists a 69 independent of y such that 


<e,| Ay| < by 


feo Avy) = SoD) _ 5105 y) | <e,|Ac| <6. (18) 
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As this relation holds uniformly for all values of y in the neighborhood 
of y = Yo, We may then write 


| f(a + Ax + ) — (xo, + Ay) : 
f(x» + Ae, yo + Ay) L(t Yo + AY) _ pre yp + Ay) | <6, 


Ax < da, Ay ~<a Os. (19) 


From the continuity of f(z, y) as to y and the uniform convergence 
of the difference quotient (15) it follows that f(x, y) is continuous 
in y and hence 


| fe (®o, Yo + Ay) — fe (xo, Yo) | < €, | Ay | < ds. (20) 
Combining (19) and (20), we have 


f(x + Ax, yo + a — f(xo, yo + Ay) — fi(xo, yo) | < 2e, 


| Ax | < do, | Ay | < 4, 


where 6 is the smaller of the two numbers ds, ds. From this inequality 
we have, after multiplying by | Av |, 


| f(ao + Ax, yo + Ay) — f(r, Yo + Ay) — Ax f.'(xa, yo) | < Qe | Ax], (21) 


where | Ar | < do, | Ay | < 6. Making use of the relation given by 
(17) and (21), we have from (16) 


f(%o + Ax, yo + Ay) — f(ro, vo) - a fe (®o, yo) — Av fy (ro, . Yo) 
A(x, 2 


eo At ltl Avl . 5 
aé AG, y es 2/5 2*€, 
Since € is arbitrarily small, 1t follows that the left-hand member of 
this inequality approaches the limit zero as Ar, Ay approach zero 
simultaneously. Hence, it follows that f(x, y) is totally differentiable 

at (Wo, Yo), as the theorem states. 
A corresponding theorem may be stated by assuming that the 

difference quotient s 
F(e, yo + Av) — f(®o, Yo) 
Ay 


converges uniformly. From the foregoing theorem, it also follows 
that f(x, y) is totally differentiable in a given region FR if in this region 
fr, fy exist and one of them converges uniformly. It is also sufficient 
if both of the: derivatives fy, fy exist and one of the second partial 
derivatives f.", fy’ is bounded as to (x, y) together; for, in this case, 
one of the fir st partial derivatives must converge uniformly . 
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35. Interchange of the order of differentiation. We shall inquire 


into the conditions under which 
ce pala 
dyox dxdy’ 
where 2 = f(x, y) is a function of the two independent variables « 
andy. That this is not always possible is illustrated by the following 


example. 


Ex. 1. Given f(a, y) = zy (S—4) for « ~ 0, y #0, and let f(0,0) =0. 


+Y 
Test the interchange of order of differentiation at the origin.’ 
For z ~ 0, y + 0, we have 

Of _ (5 -—y 4x2y? of e(@= y Any? 

dc ety @+yy/ dy “le ty @+yt/ 
To get the value of these derivatives for x = 0, y = 0, we must make use of the 
definition of a partial derivative rather than substituting the values of # and y 
in the above results; for, they were obtained on the condition that « ~ 0, y # 0, 
and are indeterminate forz =0, y=0. We have 


aan eae ee 
Pes) es Ac |(Ax)? +0 : 

' 0 - Ay{0- (Ay)? 

7G, 0)= L Wy! 60, 
eo Ayo Ay |0+ (Ay)?) ? 


Both of the first partial derivatives f/, f,/ exist everywhere and are continuous at 
the origin. Hence, their derivatives are given by the following limits.’ 


x + Ax, 0 + Ay) —f(0 + Ax, 0) — f(0,0 + Ay) +£(0, 0) 
Ax Ay 


ty ’ 7 L 
f eg e) Az—0 Ay-0 
= if ib, ie at ron if 
Az—0 Ay-0 (Az)? + (Ay)? d 


” 2 { (Az) = Ay] 
fee (0.0) nee avo |x) + ( al ; 


1 See Stolz, Differential-und Integralrechnung, Vol. 1, p. 150. 

2 The earlier writers assumed the interchange of the order of differentiation 
as evident. Nicholas Bernouilli, Euler, and Cauchy took this point of view. 
Doubtless P. H. Blanchet was the first [Jour. Math. (1) Vol. 6 (1841) ] to examine 
the conditions under which the order of limits can be reversed, although his work 
was not rigorous, as may also be said of the investigations of the subject by 
Linderhéf [Acta. Soc. Sci. Fennicae, Vol. 8 (1867), No. 7] and Genocchi [Att. 
Acad. Torino, Vol. 4 (1868-9)]. Hermite in his Cours danalyse (1873) and 
Laurent in his Traité d’analyse (1885), following the method of Lagrange, make 
use of Taylor’s series, thus assuming the existence of all of the partial derivatives. 
Later contributions in restricting the conditions imposed upon f(z, y) and its 
derivatives have been made by Peano [M athesis (1) Vol. 10, (1890) ], Schwarz 


[Math. Abh., Vol. 2, (1890)] and others. 
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Consequently, we have the condition that 
9°f(0,0) _, (0, 0) 
Ox Oy Oy Ox 
although it may be shown that the order of differentiation can be interchanged 
at every other point of the finite region. 


The following theorem gives a convenient test. 


TueoreM I. If the partial derivatives f, and fyi exist at all points 
in the neighborhood of (x0, yo) and fyt ts continuous in (x, y) at (Xo, Yo), 
then fz), (xo, Yo) exists and ts equal to fyz (Xo, Yo). 


If we regard yo and Ay as constant, we may put 
F(x) = f(x, yo + Ay) — f(x, yo). 


From the existence of f//, it follows that f must exist at all points 
in the neighborhood of (2, yo) and hence that F(x) is continuous and 
F’(x) must exist. By applying the Law of the Mean to F(x) we have 


F(a + Ax) — F(a) = Ax F’(ao + 0,Azxz),0 < 0, < 1. 

If written in terms of f(x), this relation becomes 
{f(@o + Ax, yo + Ay) — f(to + Ax, yo)} — {f(xo, yo + Ay) — f(x, yo) } 

= Ax{fs (to + O:Azx, yo + Ay) — fz(%o + Az, yo)}. (1) 
Regarding 2 + 6,Az as a constant the right-hand member of this 
equation becomes by a second application of the Law of the Mean 

Axdy{fy:(to + 0:Az, yo + O2Ay)},0 < O2 <1. 

Hence, dividing by ArAy we have 


f(wo + Ax, yo + Ay) — f(to + Ax, yo) — f(xo, yo + Ay) +f (20, yo) 
Ax Ay 
= Ag 4- 6,Az, Yo + 6.Ay). 
As fy is continuous with respect to x and y together at (x, yo), we 
write 
L f(to + Az, yo + Ay) — f(to + Ax, yo) — f(xo, yo + Ay) + f(xo, Yo) 
Ayo — 
= EE Fial eo + O,Az, yo + O2Ay) = fyz(xo, Yo). 
Ay-0 


Since, f,/ exists at all points in the neighborhood of (2, yo) the limit 
of the first member must exist as Ay approaches zero for each value 
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of Az in the neighborhood of zero. Likewise, from the existence of 
fz, the limit of this expression must exist as Az approaches zero for 
each value of Ay in the neighborhood of zero. Hence, by Theorem 
V, Art. 24, we may replace the double limit in the first member by 
the sequential limit taken in either order and hence write 


eee, F(@o + Ax, yo + Ay) —f(%o + Ax, yo) — f(to, yo + Ay) +f(X0,Yo) 
Az30 Ay-0 Az Ay 


= fyz(Xo, Yo); 
or Sey(%o, Yo) = fyz(Xo, Yo); 
which was to be established. 

The conditions given in the theorem are sufficient but not neces- 
sary. For, as the following example shows, it is possible to interchange 
the order of differentiation even though neither fz) nor fyz is con- 
tinuous in (2, y) at the point. 
Bee ener hee 
derivatives f21 (0, 0), f72 (0, 0). 

For z ~ 0, y ¥ 0, we have 


log (a? + y?), where f(0, 0) =0. Discuss the 


fi -5{ 1 + logis? +4) } fy ~¥{1 +logit +y") 


z 
and hence SR Ape eee eee 
Sed ae y? 


For z = 0, y = 0, we have from the definition of partial derivatives 
fz =f, = zy > yz =0. 
While the order of differentiation can be interchanged at every point, neverthe- 


less neither of the derivatives f2j, f/4 is continuous in (z, y) at the origin, since 
the limit of these derivatives as « and y approach zero simultaneously is not zero. 


If f/ is continuous in x and in y and the partial derivative tux exists 
and is finite at all points in a given closed region RF, then it follows 
that f// is at most point-wise discontinuous in (a, y). If f, also exists 
everywhere in R, then by the foregoing theorem, the points at which 

”” must exist and be equal to f,z are everywhere dense in R. More- 
over, these points form a set having the cardinal number of the con- 
tinuum. A corresponding statement can be made concerning the 
partial derivatives f,/, f7, fzj. This result also shows that it is impos- 
sible for the two partial derivatives f1;, fyz to both exist at every point 
in R and be distinct at all points. Moreover, it would be impossible 
to have both exist at all points and be equal merely at those points 


where both codrdinates are rational. 
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Consider the three ratios 
F(z, y, Ax, Ay) = 
f@ + As, y + Ay) — f(x + As, y) - fe, y + dy) +f/@y) 
Aa Ay 
tales ] of Ay) — fz (a, y), LPAe cs Ax, y) == Ie; y). 
Ay Ax 

By an argument similar to that employed in the proof of Theorem VII 
of Art. 31, it may be shown that these three ratios must have the 
same least upper bounds and the same greatest lower bounds in a 
given region R, provided, of course, that x, y, Az, Ay are so taken 
that the points 


(x, Y), (x ae Ax, Y); (x, y a3 Ay), (x ae Az, y ct Ay) 


all lie in R. Hence, the derivative numbers of fz with respect to y 
and of f,/ with respect to x have the same least upper and the same 
greatest lower bounds. These derivative numbers are functions of 
x and y. They have the same (2, y) saltus, at each point. At any 
point where this saltus is zero; that is, where they are continuous 
functions of (x, y), the partial derivatives f7/, f/ exist and are equal. 
Consequently, if we assume that f7/, f/; both exist at every point 
of R, then it follows that at any point where one of them is continu- 
ous in (2, y) the other is also, and hence from Theorem I they are 
equal.! If one is discontinuous in (a, y) the other is also, and they 
have the same (a, y)-saltus at the point. Thus, for the function con- 
sidered in Ex. 1 the partial derivatives fy), f/; are continuous except 
at the origin. 

For functions of a single variable, we saw that if f’(x) exists for 
x ~ % and has a limit as x approaches 2, then that limiting value 
is the value of f’(x) at x. The corresponding theorem for functions 
of two variables may be stated as follows. 


TuHeoreM II. Let f(x, y) be continuous and have the partial deriv- 
ative fyz at all points other than (2o, yo). Also, let f7(xo, yo) exist and 
L fiz (@,y) = A. 
xz2—- Xo 
y—Vo 
Then fyz exists at (xo, yo) and is equal to A. Moreover, if f,/ also exists 
in the neighborhood of (xo, yo), then fz exists at (xo, yo) and is equal 
forte 
1 See Schwarz, Gesammelte Math. Abhandlungen, Vol. 2, pp. 275-284; also, 
W. H. Young, Fundamental Theorems of Differential Calculus, p. 67. 
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For convenience, put 
F(Az, Ay) = f(x + Ax, yo + Ay) — f(a + Az, yo) 
— f(o, yo + Ay) + f(%o, yo), (1) 
and o(x, Ay) = f(x, yo + Ay) — f(z, yo). (2) 
Since fyz exists for x # 2%, y ¥ Yo, it follows that f/ must also exist 


in the open interval (x, % + Az), and hence from the Law of the 
Mean, we have, regarding Ay as a constant, 


F(Az, Ay) = (Xo + Az, Ay) al (Xo, Ay) = Ax hz (Xo Si 6,Az, Ay), 
Oral is) 
By differentiating (2) we obtain 
pz (x, Ay) = fe(x, yo + Ay) — fé(a, w). ‘i 
If we apply the Law of the Mean to the second member of this equa- 
tion, we may write 
bz (x, Ay) = Ay fre(x, yo + O2Ay),0 < 2 <1, 
whence from (3) 
F(Az, Ay) = Aa Ay fyi(ao + 0:Az, yo + O2Ay). (4) 
Introducing the auxiliary function 
y(Az, y) = f (Xo at Ax, y) ~~ f(xo, Y); 
we may write (Az, y) = Azx{fz (a, y) + p(Az, y)}, 
where i L p(Az, y) = 0 


for any value of y in the given region R. Whence, we have from (1) 


F(Az, Ay) = ¥(Az, yo + Ay) — Y(Az, yo) 

= Ar{ fi (#0, yo + Ay) — fz(ao, yo) + p(Ax, yo + Ay) 

— p(Az, yo)}. (5) 

Equating the two values of F(Az, Ay) given in (4) and (5), we have 
after dividing by Ax Ay 
fz (xo, yo + Ay) — fz (Zo, Yo) a p(Az, yo + Ay) — p(Az, yo) 

Ay Ay Ay 
= fix(to + Ax, yo + O2Ay). 


Since the simultaneous limit of the second member exists as Az, 
Ay approach zero and is equal to A, the same limit must exist for 
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the first member. However, since the limit of the first member as 
Az approaches zero also exists for all values of Ay 40, we may 
evaluate the simultaneous limit by first allowing Az to approach 
zero and then allowing Ay to approach zero. Passing to the limit 
in this manner, we have 
Fy2(%o, Yo) = ree Fyx(to + OAz, yo + O2,Ax) = Siz, y) = A, 
Ay y—Yo 


which establishes the first part of the theorem, and hence fy7 is con- 


tinuous in both variables together at (0, yo). 

If in addition to the existence and continuity of f/; we have the 
condition that f,/ exists in the neighborhood of (20, yo), then it follows 
from Theorem I that f?/ also exists at (xo, yo) and is equal to fz (Xo, Yo). 

Either of the derivatives fi), fy; can exist at a point (2%, yo) even 
though the simultaneous limit of the derivative does not exist. The 
function considered in Ex. 1 furnishes a simple illustration. As we 
have seen, both of the partial derivatives f/, f, exist at the origin. 
For « # 0, y ¥ 0, we have 


1 2 ye 82x?y? é 
EH ME ay a8 y? (x? be y?)? 

However, the limit 

2 ey? {4 Say? | 

ae x et y? ie Je y?)? 
does not exist; since, by allowing x to approach zero first and then 
y to approach zero, we obtain — 1, while if the order of the limits is 
reversed we get + 1. 

The following theorem often gives a convenient test for the inter- 

change of the order of differentiation. 


TueoreM III. Jf fi, and fyi both exist in a region R and each is 
continuous in x alone and in y alone, then the two are equal at every 
point of R. 


From the continuity of ft, fi, in x and in y it follows that the 


points of (x, y) continuity of these derivative functions form a set EZ 
everywhere dense in the given region R. As we have seen, these 
points of continuity are the same for the two derivatives, and at 
every such point they are equal. Moreover, such points are every- 
where dense on any line parallel to either axis of coérdinates; for, 
any line y = y may be used for the limiting boundary function 
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S(, Yo) and the theorem for the continuity of a function along this 
line can be applied. Let (20, yo) be any point of & not belonging to 
E. We shall show that f// and f// are also equal to each other at 
(ao, yo). From the continuity of f/; with respect to x, we have 

L fay(X, Yo) = fz(Xo,¥o). 


z—Xo 


Similarly, since f// exists and is continuous in x, we have 


L fiz, Yo) fe Siz( Xo, Yo). 


22 


As each of these limits exists, we may obtain the limiting value by 
allowing x to approach x through any set of points dense at 2. 
Let {an} be a subset of # on the line 


U==—Yo 
dense at 2; at each point of which, f/) and fy? are equal. We have 
then 
L fain, Yo) oor L IAC. Yo), 


In—TZo 


whence (a0, Yo) = fuz(Xo, Yo): 


This theorem gives a sufficient but not a necessary condition as 
the following example shows. 


Ex. 3. Given f(z, y) =7y’ cos > for all values of y, so long as  # 0, and let 


f(z, y) = 0, for x = 0. Consider the interchange of order of differentiation. 
For z +0, y 0, we have 


Aas | 
zy = Suz = 40Y cos = + 2y sin 5: 


For (z = 0, y #0), (x =0, y = 9), and (xz ~ 0, y = 0) we obtain 


vt vr 
yee Oy 


Consequently, these second partial derivatives exist and are equal at every point 
in every neighborhood of the origin, but neither is continuous in z if y £0, 
since the limit 
L {Ary Ses + 2y sin >| 

2-0 x x 


does not exist. It will be noted, however, that both fi) and fj; are continuous 


in (z, y) together at the origin, since the simultaneous limit exists as x and y 
approach zero; that is, we have 


war 
L [Ay fos + 2y sin =} = 0=f2%, (0, 0) = fyz (0, 0). 

z—0 x v 

y0 


The conditions of Theorem I are therefore satisfied. 
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EXERCISES 


1. Given f(x) =2 sin? ‘ where f(0) = 0. Does this function have a first deriva- 


tive at 2 =0? Does he second derivative exist at the origin? Show that the 


o p, Heo Ax) = flee) + flee = Av) 


ee (Ax)? » where 2% = 0, 


exists, and explain why its existence does not insure the existence of f’’(0). 
2. Given f(x) = sin x sin — where 0 < x < 27. Show that f’(x) does not 


exist at the points x = 0, 7, 27. 
: ie el Fees he 

8. Show that the function f(z) =4+7x%+2 (s +2 sin =) where x sin 738 
zero for x = 0, has a first derivative but no second derivative at the origin. 

4. Given a function f(x) whose derivative exists everywhere and is finite. 
Can j’(x) be discontinuous at a set of points of the second category? at the set 
of rational points? at the irrational points? Can a function F(x) exist whose 
derivative function F’(x) is continuous where f’(z) is discontinuous and dis- 
continuous at the points of continuity of f’(x)? 

5. By the method of Art. 30 construct the function y = f(x; 3, — 2, 3) defined 
as follows and show that it is continuous but can not have a finite derivative at 
any point. To determine the values of y, divide the interval 0 S$ x < 1 into 
three equal parts and the interval 0 S y <1 into four equal parts, corresponding 
to z = 0, 4,2, 1, let y = 0, 8,4, 1; that is, by the first division Az = 4, 4, 4 and 


Ay =8, —3, $. Continue this method of division indefinitely, thus completely 
defining the given function for the entire interval. [See Math. Annalen, Vol. 52, 
p. 67.] 


6. Does the function f(x) = ise =, where f(0) = 0, have a derivative for x = 0? 


7. Set up a function (a) whose four derivative numbers are distinct at x = 0, 
(b) whose right-hand derivative numbers at x = 0 are both negative and left- 
hand both positive, (c) one of whose right-hand derivative numbers at xz = 0 is 
positive and the other negative, while on the left both are positive. 

8. Given a function f(x) defined as follows. For x > 0, f(x) = zt+4a; for 
zx <0,f(x) =z3-a; forz =0, f(x) = 0. Is f(x) continuous at x = 0, and does it 
have a derivative at that point? 

9. If f(x) is continuous and has a finite derivative at every point in the closed 
interval (0, 1), can f’(x) have a removable discontinuity? Can it have a dis- 
continuity of the second kind? [Illustrate your conclusion in each case. 


10. Given f(z, y) = a P x £0, y + 0, where f(0,0) = 0. Show that f/, 
fy exist at (0, 0) and examine the continuity of f/, f,/ with respect to x and to y 
and (x, y) together. 8 

11. Given f(z, y) = “ae = t = 0, y ¥ 0, where f(0, 0) = 0. Show that f(z, y) 
is not totally diferentabl at (0, 0). 

12. Let f(z, y) = ser = for z ¥ 0, y ¥ 0, and let f(0,0) = 0. Show that f/, 


J, are both satan in x and in y, but that f(z, y) is not totally differentiable 
at the origin. Is f*¥(0, 0) = fyz(0, 0)? 
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13. Show that it is possible for a function f(x) to be discontinuous at a set of 
points everywhere dense and still have a finite derivative at a set of points 
everywhere dense (see Math. Annalen, Vol. 70, p. 561). 

14. Examine the following functions for total differentiability and for inter- 
change of the order of differentiation at the origin. 


(a) f(z, y) = es =’ « 0, y = 0, where f(0, 0) = 0. 
e+y 
(b) f(a, y) = (2? + y?) sin = x £0, y € 0, where f(0, 0) = 0. 
ea 
PEER 
(c) f(a, y) = zy: x = 0, y ¥0, where f(0, 0) = 0. 
e+y 


y 

(d) f(x, y) = log (x? he y'), LA 0, O Ge 0, where (0, 0) = 0. 
(e) f(z, y) = V2? +¥ sin 26, where f(0, 0) = 0, ¢ = are tan is 

(f) f(a, y) = y?sin = where f(z, 0) = 0. 

(9g) f(z, y) = v2 arc tan = — y’ are tan 7 x40, y £0, 

where f(0, 0) = 0 and — 5 < are tan < a 

(h) fay) =|2-y* |. 

15. Can the partial derivatives f/, f,/ be discontinuous in (x, y) together and 
yet fry =fyz? lustrate. : 

16. Given a region R where f(z, y) is continuous in x and y together and 
2 = 0, f, = 0 for all values of x and of yin R; show that f(z, y) is a constant 
in R. 1 

17. Show that for the function z? sin a’ where f(0) = 0, the derivative num- 
bers in the neighborhood of z = 0 are not bounded, but that the function at the 
origin has zero as a derivative. 


18. Show that if f,, f,/ each have differentials of the first order at a point 
(xo, yo), then fj2(xo, yo) = fz4(o, Yo) and this common value is the double limit 


L [fG@0+As, yo + Ay) — f(to + Ax, yo) — f(xo, yo + Ay) + F(xo, yo) 


Azr-0 Az Ay 
Ay-0 


[See W. H. Young, Fundamental Theorems in Diff. Cal., p. 22.] 


19. A given function f(z) has a derivative at all points of the interval (a, b). 
Can f’(z) be infinite at all the rational points? at all the irrational points? 

20. Could a single-valued function f(x) exist having a derivative at every 
point of a given interval (a, b), where f’(x) takes at least once the same two distinct 
values in every subinterval of (a, b)? 

21. Knowing that f(z) has a derivative at every point in an interval (a, 6), 
is one justified without examining the continuity of f’(x) in attempting to find 
its value at a particular point a, a < 2 <b, by taking the limit L f’(x)? 
Illustrate your conclusion. mee 


CHAPTER V 
RIEMANN THEORY OF INTEGRATION 


36. Definition of a Riemann integral. From a study of the 
calculus, the reader has become familiar with the elementary proper- 
ties of an integral. An integral was considered from two points of 
view. First of all, integration was considered as the inverse opera- 
tion of differentiation, and later an integral was regarded as the limit 
of the sum of an indefinitely large number of small elements. The 
first notion was employed in evaluating an integral, the latter was 
often convenient in setting up an integral from given data. By 
means of the fundamental theorem of the integral calculus, it was 
seen that these two ways of viewing integration were, for certain 
classes of functions, only different ways of considering the same prob- 
lem. It is the purpose of the present discussion to formulate more 
precisely the definition of an integral and to inquire into the con- 
ditions under which an integral may exist. 

While some notion of integration, based upon the methed of ex- 
haustion, was known to the Greeks, a rigorous treatment of the sub- 
ject dates from the time of Cauchy and Riemann. The definition 
of Cauchy covered the case for continuous functions. This definition 
was extended by Riemann to bounded functions, and he also set up 
the condition for the existence of such an integral. Later the defini- 
tion has been further extended to make it applicable to unbounded 
functions and to integration over unbounded intervals. It is the 
Cauchy-Riemann definition which is commonly employed in elemen- 
tary analysis and in the applications to the physical sciences. More 
recently, other definitions of an integral have been introduced by 
Lebesgue, Stieltjes, Young and others, which are of special importance 
in scientific discussions, since they admit a larger range of integrable 
functions. In this chapter we shall consider the properties of the 
Riemann integrals, reserving to the following chapter a consideration 
of the Lebesgue and other integrals. 

Let f(x) be a bounded function, defined for the interval (a, b). 

198 
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Suppose this interval to be subdivided by the insertion between 
a(= 2) and b(= 2,) of the intermediate points 


O = XY, V2, °* * * » Un-1. 
Form the sum 


S() = (ea ~ af) + (ee = aidf(Ea) + + + + Gu = ta af(Es) 
= 2 Sl) Au, 


where & is any point in the interval (2, — 2,1) = Ayr. We now 
define the Riemann integral as the limit 


L & f(&) Ara, (1) 
A->0 k=1 

provided the value of this limit is independent of the manner of 
inserting the intermediate points a, and A is the largest of the A;,2’s, 
frequently called the norm of the given set of intervals. As A ap- 
proaches zero, n becomes infinite. Symbolically, the Riemann in- 
tegral is represented by 


f *t(2) dz. 


In passing to the limit, it is to be noted that the number of points 
inserted in each subinterval increases indefinitely as the norm A 
approaches zero. 

It will be seen that the foregoing definition is equivalent to saying 
that for every arbitrarily small positive number e€ there exists a 
positive number 6, depending on e€, such that for every choice of 
&, in the interval A;2 and for every subdivision whose norm satisfies 
the condition A < 6, we have 


[ee — 2 f(&) Ai | <e. 


The function f(x) as defined is bounded in the given interval and 
the limits of integration are both finite. Integrals which arise under 
these conditions are called finite or proper integrals. Later, we shall 
see how the notion of integration can be extended to cases where 
either the function itself becomes infinite at certain points or one or 
both of the limits of integration are infinite. To distinguish such 
integrals from those already defined, they are called infinite or 
improper integrals. 
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37. Upper and lower integrals.'_ Denote by Ly and I, respectively 
the Jeast upper bound and the greatest lower bound of f(x) in the 
interval Ayv = (a — t%—1). Form the two sums 


S(o) =D Ly Axe, S(o) = DL, Aue. 


The values of S(c), S(o) depend upon the manner in which the given 
interval (a,b) is subdivided by the insertion of the intermediate 
points ¢. However, for every method of subdivision, we have 


S(o) 2 1b — a), S(a)S LO — a), (2) 


where L, 1 are respectively the least upper bound and the greatest 
lower bound of f(z) in (a, b). The aggregate of values which S(c) 
may have by all possible methods of subdivision of (a, 6) by the in- 
sertion of intermediate points has a greatest lower bound which we 
call the upper integral of f(x) in the interval (a, b). Likewise, the 
sum S(c) has for all possible subdivisions of (a, b) a least upper bound 
which is called the lower integral of f(x) in (a, b). We shall denote 
these integrals respectively by 


fi f(x)dz, I f(oae. 


We shall now establish the following theorem. 


TuHroreM. If f(x) is bounded in the interval (a, b), then 
= (rb *b 
1, 5@) =| - f seas 
EPO = J, Feat, LE Slo) = J f(a)dx 


We shall prove the theorem for the upper integral. <A similar 
proof establishes the existence of the lower integral and is left to the 
reader to supply. 

By different ways of inserting the intermediate points o in the 
given interval (a, b) we have different sets of subintervals A, and 
may obtain different sums S(a). As we have seen, the aggregate of 


a, b 
values {S(o)} has he upper integral | f(x)dz for its greatest lower 


bound. We shall now show that e 
LSGye if f(x) de, (3) 
A-0 a 


1 The upper and lower integrals were first introduced and rigorously defined by 
Darboux; see Ann. Ecol. Normale, (2), Vol. 4 (1875), p. 64. For that reason they 
are sometimes called the Darboux integrals, 


Art. 37] UPPER AND LOWER INTEGRALS 201 


A being the norm of the A,’s for any method of subdivision whatso- 
ever. = 
Since fi f(x)dzx is the greatest lower bound of S(c) for all possible 


methods of subdivision of the given interval, it follows that we can 
find a particular method of subdivision for which the sum 


S(o) = 2 Lx 5% 
k=1 


pifiedes the relation’ Sion) < | Te)dx + §, (4) 
where € is an arbitrarily small positive number and 6; is the length 
of the subinterval by this method of subdivision. 

Consider any other method of subdivision. We can so select the 
points ¢, and hence A; = x — 2-1, that for this new method of sub- 
division the norm A shall be small enough to satisfy the inequality 


(m+1)L-A (5) 


where as before L is the least upper bound of f(z) in (a,b). Some of 
the resulting intervals A, may lie wholly within a 6; interval while 
others may contain portions of two or more of the 6; intervals. Those 
A, intervals falling in the first class contain no end-points of a 6; in- 
terval, while those of the second class each contain at least one end- 
point of a 6; interval. There can not be more than (m + 1) of the A, 


intervals of the second class and from (5) these contribute less than : 


to the sum S(oo). For each of the A; intervals of the first class we 
obtain a product L; A;, which is less than the corresponding product 
that enters into the sum S(o0). Consequently, from (4) we have for all 
methods of subdivision of (a, b) and for every arbitrarily small value e 


S(c)  [se)de. 


But f °H(x)de is the greatest lower bound of S(c), and hence this 


relation is equivalent to saying that 
as (> 
ipsa ji fous. 
A-0 a 


Since this limiting value is independent of the method by which 
the given interval-is subdivided by the insertion of intermediate 
points, the theorem follows, 
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38. Functions of limited variation. A class of functions which 
play an important réle in the theory of integration is that known as 
functions of limited variation. We may define this property as 
follows. Let f(x) be a bounded function defined for the interval 
(a, b). Suppose this interval to be subdivided by the insertion of 
the intermediate points 


(= a), Ty, 3, T3, * * * > Tee * * Z.(= b). 
Set up the sum 


V =| f(z) — flee) | + | flee) —fle)|+- - -+1f@) -f@)| 
+++ +1f@) -fead) 


The value of V is called the variation of f(x) for this particular method 
of subdivision. Consider the aggregate of values of V obtained by 
all possible methods of selecting the intermediate points %. If 
this set of values is bounded, the function j(z) is said to be of limited 
variation. The least upper bound of the set of values { V} is called 
the total variation of f(x) in the interval (a, 6) and is designated by 
Va f(x) c 

If in (1) we replace | f(a) — f(z) | by the oscillation @(f, 2,422) 
of f(x) in the interval (2,41, 2%), we may write for the total oscilla- 
tion in (a, 6) by this particular subdivision 


oL f(z) ] = w(f, m2) + @(f, tm) ++ - +> + @(F,2et.4). (2) 


If for all methods of subdivision the aggregate of values {a f(z) ]} 
has a finite upper bound, then we say that f(z) is of total limited 
oscillation or simply of limited oscillation! in the given interval 
(a, b). Functions which are of limited oscillation are also of limited 
variation, as the two definitions may be shown to be equivalent.* 
Consequently, either property may be employed as best suits the 
particular discussion. 

If we denote by p the sum of those differences {f(z:) — f(zi-:)} 
which are positive and by n the sum of the absolute values of those 
differences which are negative, then from (1) we have 


V=ptn. 


* Sometimes also called “bounded fluctuation,” see Hobson, Theory of Fune- 
tions of a Real Variable, 2d. Ed., Vol. I, p. 311. 

* See Study, Math. Annalen, Vol. 47 (1896), p. 298 ef seg.; see also Encyclop. 
des Sct. Math., Ih, Art. 19, p. 86. 
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Corresponding to the least upper bound of V in (a, b) there exist least 
upper bounds P and N, of p and n, respectively. Moreover, we have 


fo) -f@) =p-n, 
whence p=3{V+f(b) -f@}, 
n=3{V —f(b) +f(a)}. 


Consequently, as V approaches its least upper bound V.z f(x), p and n 
approach respectively their least upper bounds P, N for the same sub- 
divisions. The total variation of f(x) in the given interval must then 
satisfy the relation 


‘ab f(&) = Pav f(x) + New f(a). (3) 


The value of P is called the total positive variation, while that of N 
is called the total negative variation. From the foregoing discussion 
we have also the relation 


f(0) — f(@) = Pas f(x) — Nw f(z). (4) 


We may now establish the following theorems concerning functions 
of limited variation. 


TueroreM I. Jf f(x) is of limited variation in a given interval (a, b), 
then it is also of limited variation in (a, x’), wherea < a’ < b.1 


For any set of intermediate points between a and x’, set up the sum 
V’ for the interval (a, x’) similar to (1) for (a,b). The least upper 
bound of such values V’ for all possible sets of intermediate points 
can not exceed Vz f(z). As this latter value is by hypothesis finite, 
it follows that the least upper bound of V’ is finite. Consequently, 
f(x) is of limited variation in (a, x’). 


TuroreM II. A necessary and sufficient condition that a func- 
tion is of limited variation is that it can be expressed as the difference 
of two bounded, positive, monotone functions, either both non-increasing 
or both non-decreasing. 


First of all, the given condition is necessary. We assume f(x) to 
be of limited variation. If z is any point of the interval (a, 6), it 


1 In an interval (a, z), the total variation of a function is a function of 2, 
say T(x). If the given function f(z) is absolutely continuous in z, then T(z) 
may be shown to be also absolutely continuous in x. See Vitali, Att. della R. Accad. 
delle Scienze di Torino, Vol. 40, p. 1023. 
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follows from Theorem I that P,:, Naz are bounded, positive func- 
tions of x. From (4) we then have 


f(x) — f(a) = Pos f(z) ay Noz f(a); 
or f(x) = {Pas f(z) + f(@} — Naz f(2), (5) 


from which it follows that f(x) can be expressed as the difference of 
the two bounded, positive, monotone, non-decreasing functions given 
in the right-hand member of the above equation. Denote by A any 
finite number larger than Vz» f(z). From (5) we have 


fz) = {A — Nu f(a)} — {A — Paz f(x) -f @}, 


which shows that under the conditions set forth in the theorem 
f(x) may be expressed also as the difference of two bounded, positive, 
monotone, non-increasing functions. 

The given condition is also sufficient. For, suppose that f(2) can 
be expressed as the difference of the two bounded, non-decreasing, 
positive functions F(x), F2(z). We have then for any subinterval 
(tp-1, tz) of (a, 6) 


| f(x) — flee) | S {Filae) — Pi(ten)} + {PF o(ax) — Po(ae-1)}. 


Taking the sum of these values for all subintervals of (a, 6), we get 
2 Fe) — f(t) | = {Fi(6) — Fi@} + {Fe(b) - F2(a)}. 


This relation holds for all methods of subdivision, and as the second 
member of the inequality is finite, it follows from the definition of 
limited variation that f(x) has that property in the given interval 
(a, b). 

A similar proof holds for the case where F(x), F2(x) are both 
bounded, positive, monotone, non-increasing functions. 

It may also be shown that any absolutely continuous function 
may be expressed as the difference of two non-decreasing, absolutely 
continuous functions.! 


TuHeoreM III. If two given functions are each of limited variation 
in (a, b), then their sum, difference, and product are also of limited 
variation in the same interval. 


Denote the given functions by fi(x) and fo(z). From Theorem II, 
each can be expressed as the difference of two bounded, monotone, 


1See Vitali, Atti della R. Accad. delle Scienze di Torino, Vol. 40, p. 1024. 
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positive, non-decreasing or non-increasing functions. We shall con- 
sider the case where fi(x), f2(x) are the difference of two non-decreas- 
ing functions. For the other case the proof is similar. We have then 
filz) = $i) — Pal), fo(x) = b2(x) — Yala), 
where 1, 2, ¥1, Y2 are in (a, b) bounded, monotone, positive, non- 
decreasing functions. The sum, difference, and product of fi(z), fo(x) 
can now be expressed as the difference of two monotone, positive, 
non-decreasing functions as follows. 


filx) + fo(x) = {br + G2} — [Yi + Vo}, 
flv) — fox) = {gi + Po} - [fe + Yi}, 
fila) -fo(x) = {bide + Pipe} — {bai + dr}. 
Since the sum, the difference, and the product can be expressed as 
the difference of two bounded, monotone, positive, non-decreasing 
functions, it follows from Theorem II that each is a function of 
limited variation. 


TueoreM IV. [f f(x) is of limited variation, then a ts also, pro- 
vided | f(x) | = M, where M is a positive number. 


From (1) we have Gaees 
ciara Hema) = fas) 
f(a) — f(@r) F(x) f (2) 


f(ax) — f(t) 


n 


vie 
k=1 


k=1 


il n 
=p 2, 


But as f(z) is of limited variation, the sum 2 / f(%x) — f(t-1) | is 
bounded for all methods of choosing the intermediate points 2. 
Consequently, the value of V for a is, under the conditions set 
forth in the theorem, bounded and ay is therefore of limited 
variation, as the theorem requires. 

TurorEeM V. A function of limited variation can have only ordinary 
discontinuities. 


We shall assume that at some point, say 20, of the given interval 
(a, b), f(z) has discontinuity of the second kind and show that under 
this assumption f(r) can not be of limited variation in (a, 6). The 
right-hand and left-hand limits 


Lb i@), L fe) 
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do not exist, since 2 is a point of discontinuity of the second kind. 
However, there exist at % a maximum and a minimum value of f(x) 
on both the right-hand and the left-hand. We have then 


f (Xo ae 0) = f (Xo + 0), 
where f(% +0) = L f(t +e), f(t. +0) = J f(xo + €). 


It follows that to the right of x it is possible to find a set of points 
{an} = 21, 0a, ° * * 5 tk * 
dense at 2» such that we have 
| f(ax) — ft) | > A, k=1,2,° + -, 


where A is a suitably chosen positive number. As the points a, are 
dense at x) the number n of the intervals (a, — x) in (1) lying 
within (a, 6) can be made as large as one may choose. From (1) we 
have for the foregoing subdivision of (a, 6) 


V = 3 |fla) - Slew) |> nd. 


As A is by hypothesis different from zero and n can be taken as 
large as we choose, it follows that V is not bounded and consequently 
f(x) can not be of limited variation in (a, 6). From this conclusion 
the truth of the theorem follows. 


TueorEeM VI. The points of discontinuity of a function of limited 
variation form at most an enumerable set. 


This theorem follows as a consequence of Theorem VI, Art. 28, 
when we remember that a function of limited variation can have 
only ordinary discontinuities. 

A relation between absolute continuity and the limited variation 
of a function is expressed by the following theorem. 


TueoreM VII. Jf f(x) is absolutely continuous in an interval (a, b), 
then vt 1s also of limited variation in this interval. 


1 This theorem also follows from the fact that a function of limited variation 
can be expressed as the difference of two monotone functions and every monotone 
function can have at most an enumerable set of points of discontinuity. See 
Carathéodory, Vorlesungen, p. 154. 

It may be shown that the points of discontinuity of a function of limited 
variation form a set of the first species. See Lebesgue’s Legons sur V'intégration, 
p. 58. 
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For, if f(x) is not of limited variation, then there must be at least 
one subinterval of (a, b) in which the total variation of f(x) exceeds 
every finite bound, however small the interval is taken. In this 
interval, the sum of the oscillations of f(z) must also exceed every 
finite bound. It follows that in any set of subintervals including one 
of this character the sum of the oscillations of f(x) can not tend toward 
zero with the sum of the intervals. Consequently, f(x) can not be 
said to be absolutely continuous in (a, b). From this contradiction 
to the given hypothesis the theorem follows. 

The converse of this theorem is not true; that is, there are func- 
tions of limited variation which are not absolutely continuous. As a 
matter of fact, a function of limited variation may have an enumer- 
ably infinite number of points of ordinary discontinuity and hence 
is not even continuous, to say nothing of being absolutely continu- 
ous. A function may be both continuous and of limited variation 
and still not be absolutely continuous.! It may be shown, however, 
that a continuous function of limited variation, whose derivative 
numbers are infinite at most over an enumerable set HL, is absolutely 
continuous.” 

Not every continuous function is of limited variation. For ex- 
ample, suppose we consider 


f(x) 


sin 2) for ~ 0, 


ll 


= 0, forz = 0. 


As we know, this function is continuous in the closed interval (0, 1). 


It has an infinite number of oscillations in every neighborhood of the 


; : 1 1 
origin, there being one in every subinterval (= ES The 


amount of the oscillation in any one of these subintervals is greater 


than Ge Da = ae Hence, the variation Vo: [ f(z) ] satisfies the condition 
2 Hid ees kansl 1 


However, the infinite series in the brackets is divergent, and hence 


the variation is not limited. 
The foregoing function has no derivative at the origin. Even a 


1 See Vitali, Adti della R. Accad. delle Scienze di Torino (1905), Vol. 40, p. 1022. 
2 See Porter, Bull. Amer. Math. Soc. (1915), Ser. 2, Vol. 22, p. 110. 
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function having a finite derivative at every point may nevertheless 
be of unlimited variation. The function, 
f(x) -=s2" 510 >) for xz £0, 
= 0; fora = 0; 
is an illustration. This function has a finite derivative at every point 
in the interval (0, 1). One may show that it is of unlimited varia- 
tion in (0, 1) by following the method of the previous illustration. 

It is of interest to note that f(x) as defined in either of these illus- 
trations is not absolutely continuous. For, if it were absolutely 
continuous, it would be of limited variation by the foregoing theorem, 
and as we have seen, that is not the case. One must not infer that 
simply because a function has an infinite number of oscillations in a 
finite interval, it must be of unlimited variation. For, let 


f(a) = xt sin 4p for ¢<1, « #0, 


= 0, for 7 = 0. 
This function vanishes for x = : ; and has an oscillation in every’ 
1 (kar) 
interval ( 7 ea) The amount of the oscillation is 
(kar)® [(k + 2)m}® 
less than 2 
22? = = 
(kar)é 
Hence, the sum of the oscillations in any neighborhood of the origin 
is less than 2 1 
Sat eee et 
rt 2 (38 ni 


which is convergent for any value of ¢ less than one. The function 
is therefore of limited variation, since by any other method of select- 
ing the intervals the sum of the oscillations could not be increased. 

TueroreM VIII. If any one of the derivative nwmbers of a function 
f(x) ts bounded for all values of x in the interval (a, b), then f(x) is 
continuous and of limited variation. 

If one of the derivative numbers is bounded, then all are bounded 
and have the same least upper and greatest lower bounds as the 
difference quotient. We may write for every pair of values 2, 2x2 
my) f(a) = f(x) 


Z1 — Xe 


< M, 
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where M is a finite number. The total variation of f(x) in (a, b) can 
not exceed 2M(b —a). Since this product is finite, it follows that 
(x) is of limited variation in the given interval. 

The function f(x) is continuous; for, a function of limited varia- 
tion can have only ordinary discontinuities (Theorem V) and this 
can not occur, since in that case at least some of the derivative num- 
bers are no longer bounded. 

The converse of the foregoing theorem is not true; that is, there 
are continuous functions of limited variation whieh do not have 
bounded derivative numbers for some values of x. For example, the 


function fla) = te 5 


is continuous and of bounded variation in any interval including the 
origin, but its derivative numbers at the origin are not bounded. 

39. Existence theorems for Riemann integrals. We shall con- 
sider the conditions under which a Riemann integral may exist; 
that is, the conditions which must be imposed upon the function f(z) 
in order that the limit (1) of Art. 36 may exist. The first of these 
theorems may be stated as follows. 


TuEorEM I. Given a function f(x) which is bounded in the eal 


(a,b). A necessary and sufficient condition that the integral Co (a)dx 
exists 1s that 
AE S(a)dx = le f(x)dz. 


We may show that this condition is sufficient by considering the 
gooey, S(a) < S(a) < S(o), (1) 


where S(a), S(a), S(o) have the values assigned to them in Arts. 
36, 37. Since by any method of subdivision we have 


Eb S8(0) = ip faa, L Sto) = f a)dr, 


and since by hypothesis the upper and the lower integrals are equal, 
it follows from Theorem IV, Art. 24, that the limit 


L S(c) 
A0 


b 
exists and f(x) is integrable, the integral uP f(x)dzx being the common 


value of the upper and the lower integrals. 
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The given condition is also necessary. To show this, we have the 
condition that the limit en 
Fer gc T(E) Ay 
exists for all methods of subdivision of the given interval and for 
all values of & in Agr. It follows that the limit still exists if f(&&) is 
replaced by the least upper bound Ly or by the greatest lower bound 
l, of f(x) in Aye. However, when these values are substituted, we 
ay 

have nothing else than the upper and the lower integrals ; f(x)dz, 
~ a 

| r (x)dx, respectively, and their existence and equality follow as a 


e/a 


consequence of the fact that they are special cases of the given limit. 

It is sometimes convenient to have the condition of integrability 
expressed in terms of the oscillation of the function. Denote by wx 
the oscillation of f(x) in the interval A,r; that is, put 


aw, = w(f, Ax). 
We can then form the oscillatory sum 


Li 
Q,.[ f, ab] = 2 w;, Axe, 
and state the following theorem. 


TueoreM II. A necessary and suffictent condition that a bounded 
function f(x) ts integrable tn the Riemann sense ts that 
L Qf, ab] = 0. 
A-0 
The sum 2, may be written 
Qf, ab] = = {Le — Le} Age 
t=1 
= S(o) — S(o). 
As each of the limits L Ny (g), L S(o) exists, we then have from the 
A-0 —0 
condition given in the theorem 
L Q, , h are DL LS “= S = 
AE, MLf, ab] = L 8(e) - S(@)} = 0, 
and hence L S(o) = L S(o). 
A>0 A->0 
By Theorem I, it follows that this common value gives the integral 
te) 
if f(x)dx; that is, we have in the limit 


[i (x)dx = i fds = ap f(@a)de. 


This conclusion ‘shows that the given condition is sufficient. 
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The given condition is also necessary; for, if the integral exists, 


we have a3 
i(adn = { f(e)de, 
or L S(¢) = L S(c) =A, 
A-0 A-0 
whence 


LIS) Lo Sig) = S - = = (), 
4b, 8(@) — Lb S(e) = LIS (o) - S(@)} = L OL f, ab] = 0 
We have also the following theorem due to Riemann.1 


THEOREM III. Given a function f(x) which is bounded in the 
interval (a,b). A necessary and sufficient condition that the Riemann 
iniegral of f(x) exists in (a, b) is that this interval may be divided into 
partial intervals such that the sum of the lengths of those subintervals in 
which the oscillation of f(x) is equal to or greater than any arbitrarily 
chosen positive number n may be made as small as one pleases. 


We may show as follows that the given condition is sufficient. 
Denote by S,, the sum of the lengths of the subintervals of (a, b) 
in which the oscillation of f(x) is equal to or greater than y, and let 
C(S,,) be the sum of the lengths of the remaining subintervals of 
(a, b); that is, the sum of the lengths of those subintervals in which 
the oscillation is less than 7. We may then write 


QL, ab] < n(b - a) + Sn- , (2) 


where w is the greatest value of the oscillation w, of f(x) in those 
subintervals included in S,,. The value of w is finite and can not 
increase as the size of the intervals is decreased by making the 
norm A to approach zero. By hypothesis, we have 


S72, <. € 
where € is positive and may be chosen arbitrarily small. We then 
have from (2) Oey abieanoeate: 


where €, is arbitrarily small. Since this relation holds for every arbi- 
trary choice of 7 and €, however small, we have 


L Qa[f, ab) = 0, 
A-0 
and consequently f(x) is integrable by Theorem II. 


1 See Habilitationschrift, Gottingen, 1854, §5; see also Gesammalte Werke 
(2d Ed., 1892), p. 240. 


ie RIEMANN THEORY OF INTEGRATION [Cuar. V 


To show that this condition is also necessary, we proceed as follows. 
We assume that f(z) is integrable in (a, 6), and hence we have from 


Theorem II L-O,Cf, ab] = 0. (3) 
A-0 


However, we may write 


QL, ab] = % ww 29-84 +0-CSn) = 0Sm 4) 


where w is the smallest value of ; for the n subdivisions of (a, }). 
Making use of (3) we have from (4), by passing to the limit, 


x b]=O02n7n- L Sy, 
EL eLh o] Cai A—0 


While 7 is arbitrarily chosen, it is greater than zero. Since both 
and S, are positive we must have 


TS. = 0; 
Thee m ? 


that is, we have Se <6 
where € is arbitrarily small. 

It follows from this theorem that if the points of discontinuity 
where the saltus exceeds 7 form a set of the first species, then f(z) 
is integrable. These points may also form a set of the second species 
and still have f(x) integrable in the given interval, but this is not 
necessarily true as is the case where the points in question form a 
set of the first species. 

As a corollary to the foregoing theorem we may state the fol- 
lowing: 


Cor. A necessary and sufficient condition that a given bounded func- 
tion is integrable is that its points of discontinuity where the saltus is 
equal to or greater than an arbitrarily chosen member n form a discrete 
Set. 


By introducing the notion of measure, we may state the following 
important criterion for integration. 


TurorEM IV. A necessary and sufficient condition that a bounded 
function f(x) 1s integrable in the Riemann sense is that in the given inter- 
val the points of discontinucty form a set of measure zero. 


To show that the condition is necessary, consider a sequence of 


values Mo Ne > Ys ea ee 
where Lenn=20) 


no 


. 
? 
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and let (a, b) be the interval within which f(x) is bounded and in- 
tegrable. Denote by HE, (n = 1, 2,+ - -) the set of points of (a, b) 
at each of which f(x) has a discontinuity with a saltus equal to or 
greater than 7,. The sequence of point sets {H,} satisfies the con- 


dition that 
He eB, <u 


All of the points of E,, belong to subintervals of (a, 6) within which 
the oscillation of f(x) is at least equal to y,. By Theorem III, the 
sum of these subintervals may be made as small as we please and 
hence the measure of the set HL, is zero. 

All the points of discontinuity H of f(z) in (a, b) are included in 


the sum 
Fit Ho+- + -+Hat+: : 


The measure of H#, by Theorem VIII, Art. 21, is 
PonE =a le 0 0) 


Hence, it follows that the conditions of the theorem are necessary for 
the integrability of f(x) in (a, b). 

The given condition is also sufficient. For, the set Ho of points 
of discontinuity of f(x) where the saltus is equal to or greater than 
a given number 7 is a closed subset of H. By hypothesis the set 
E is of measure zero, and hence the subset H> is also of measure 
zero. But Ey is closed and consequently its content is identical 
with its measure. By the corollary to Theorem III, f(x) is therefore 
integrable. 

By aid of these theorems, we are now able to determine certain 
classes of functions for which the Riemann integral always exists. 
These results will be stated in the following theorems. 


TuroreM V. If f(x) ts continuous in the closed interval (a, b), then 


the integral ip f(x)dx exists. 


It follows at once, since (a,b) is a closed interval, that f(x) is 
bounded and hence the foregoing theorems apply. As there are no 
points of discontinuity, the conditions of Theorem III are satisfied 
and the theorem follows. 


TuroreM VI. A bounded function f(x) having a finite or enumerably 
infinite number of discontinuities is integrable in the Riemann sense. 
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As we have seen, every enumerable set is of measure zero. It then 
follows from Theorem IV of this article that f(x) is integrable. 

From this theorem one sees that a bounded function may be dis- 
continuous at the set of rational points and still be integrable, pro- 
vided it is continuous at the irrational points. 


Turorem VII. A function f(x) of limited variation in the closed 
interval (a, b) is integrable in the Riemann sense. 


The given function is bounded and by Theorem VI, Art. 38, its 
points of discontinuity form at most an enumerable set. Conse- 
quently by Theorem VI it follows that f(x) is integrable. 


TueoreM VIII. A bounded function f(x) having only ordinary 
finite discontinuities in the given interval (a, b) is integrable in the 
Riemann sense. 


By Theorem VI, Art. 28, it follows that the points where the 
given function has ordinary discontinuities form an enumerable set. 
From Theorem VI it follows that f(x) is integrable in the interval 
for which it is defined. 


THEOREM IX. Every bounded, monotone is f(x) ts integrable 
in the Riemann sense. 


Let the given interval be (a, 6) and suppose that € as usual is an 
arbitrarily chosen positive number. By taking n, the number of 
divisions of (a, 6), sufficiently large, we can make the norm A of the 
subintervals so small that 

na é 
i) -F@ 


We have for the oscillatory sum 


Qf, ab] s AE ty) - fla} = Aff) -f@)} = 
Passing to the limit, this relation becomes 
L Y= 
A-0 
and the given function is integrable by Theorem IT. 
Since every bounded, monotone function is integrable, and the 


points of discontinuity of an integrable function form a set of 
measure zero, we have at once the following corollary. 
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Cor. If f(x) is a bounded, monotone function, then its points of dis- 
continuity form at most a set of measure zero. 


It is to be noted that not every point-wise discontinuous function 
is integrable. While a necessary and sufficient condition for a func- 
tion to be point-wise discontinuous is that its points of discontinuity 
where the saltus exceeds a given number e¢ forms a set in no sub- 
interval everywhere dense and while a discrete set can not be every- 
where dense in any portion of the given interval, it is true that there 
also exist point sets which are not discrete which also satisfy this con- 
dition. We can not say, therefore, that a point-wise discontinuous 
function f(x) is integrable unless it satisfies still other conditions. 

40. Integrals of bounded functions. We shall limit our discussion 
to those properties of definite integrals not commonly discussed in an 
elementary course in calculus, and in the present article the discussion 
is concerned with bounded functions. Among the more important 
theorems relating to definite integrals of bounded functions we have 
the following: 


TueoreM I. Jf f(x) is integrable in (a, b), it is rene in any 
subinterval of (a, 6). 


Let (a, 6:) be any subinterval of (a,b). By the corollary to 
Theorem III of the previous article, f(x) can have in (a, b) at most a 
discrete set H of points of discontinuity where the saltus is equal to 
or greater than an arbitrarily chosen number 9. It follows at once 
that the points having the same property and situated in (a, b:) must 
likewise form a discrete set, since it is a subset of H. Consequently, 
it follows also from the corollary to Theorem III of the last article 
that f(x) is integrable in (a, b:), as was to be shown. 


THEOREM II. Given a finite number of functions fi(x), fo(z),- + +, 
fr(x) each of which is integrable in (a,b). It follows that 


Ji@ +h@) ++ + + + f.@)} de = 
[floras + | floda fers) es + J fola)de. 


This theorem follows at once from the definition of a definite 
integral as a limit and the fact that each of the n limits exists; for, 
the limit of the sum is then the sum of the separate limits. This 
theorem still holds if each function is multiplied by a constant. 
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The following theorem, due to Du Bois-Reymond, is of importance 
in the discussion of integrable functions.! 


TuroreM III. If ¢i(x), 2(x), - + + Gn(x) are a finite number of 
bounded functions integrable in the closed interval (a, b), then any con- 
tinuous function F(¢1, $2, ° * +, Gn), considered as a function of x, 
is integrable in (a, 6). 


We shall prove the theorem for the case of two functions ¢i(2), 
g(x). The argument is the same for the case where n has any 
finite value. 

As x takes the values in the interval (a, 6), suppose that the values 
of $1, 2 lie within the closed intervals (q, d:) and (c2, dz), respec- 
tively. Within the region defined by these intervals, F(¢i, ¢2) is by 
hypothesis a continuous function of ¢1, gz. Put 


f(x) = FLe¢i(z), ¢2(z) J. 


The only points of discontinuity which f(z) can have are those of 
¢i(x) and (x); for, at any other point f(x) is a continuous function 
of a continuous function and hence is continuous. 

For any arbitrarily selected 7, the points of discontinuity of ¢,, 
¢2 where the saltus is equal to or greater than 7, form a closed dis- 
crete set and hence their sum, which we shall denote by E,, is also 
closed and discrete. Let 7, take a sequence of values 


Dig ase ees 7 hw ees 


having the limit zero as n becomes infinite. Corresponding to these 
values, we have a sequence of point sets {H,} and we shall denote 
the limiting set of this sequence by #. The set of points of discon- 
tinuity G of f(x) for which the saltus is greater than an arbitrarily 
small 7 is a closed subset of H. By Theorem V of Art. 20, it fol- 
lows that G is discrete and consequently f(x) is integrable in the 
interval (a, b). 

{t follows from the foregoing theorem that any rational function 
of an integrable function is integrable, provided the denominator 
does not vanish in the given interval. Thus, the product of a finite 
number of integrable functions or any integral power of an integrable 
function is integrable. Likewise the quotient of one integrable 
function by another integrable function is integrable if the function 
by which one divides is not zero in the given interval. 


1 Math. Annalen, Vol. 20 (1882), p. 122 
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From Theorem II, we saw that the integral of a sum of a finite 
number of integrable functions is the sum of their integrals. It must 
not be inferred from the present theorem that the integral of any 
rational function of integrable functions is that function of the in- 
tegrals. For example, it does not follow that the integral of the 
product of two integrable functions is the product of their integrals. 

The question naturally suggests itself whether one might not 
generalize the foregoing theorem by showing that every integrable 
function of an integrable function is integrable, just as we have seen 
that every continuous function of a continuous function is continuous. 
That this generalization is not possible is shown by the following 
illustration.! 


Let y = $(x) be defined as equal to zero for irrational values of x and equal to 
— for x equal to P, where p and q are prime to each other; that is, for rational values 
of z. Define f(y) as equal to one, except for y equal to zero, where it takes the 
value zero. The integral if. ¢(x)dx exists by Theorem VI of Art. 39, since (x) 
is bounded and has at most discontinuities at the rational points; that is, at an 
enumerable set of points. Moreover, the integral if f(y)dy exists as it has but 
one discontinuity and that is finite. However, the function 
F(x) = fL¢()] 
is not integrable; for, it is totally discontinuous, having the value one at all 
rational points and zero at all irrational points. 


TuroreM IV. Given two bounded functions having the same points 
of continuity. If one is integrable, then the other vs also.” 


Let the two functions be ¢:(z), ¢2(x) and suppose that one, say 
$.(z), is integrable. By Theorem IV of the last article, the points of 
discontinuity of ¢:(x) must form a set of measure zero. Since ¢2(z) 
has the same points of continuity as ¢1(z), its points of discontinuity 
form at most a set of measure not greater than that of the disconti- 
nuities of ¢;(7). It must then have the measure zero and hence ¢2(2) 
is integrable, as the theorem states. 


Turorem V. If f(x) and (x) are both bounded, integrable func- 
tions in the interval (a, b) and f(x) is positive, then 
Hove h ia e 
is also integrable in (a, 6). 


1 See Lebesgue, Lecons sur V’intégration, p. 30. 
2 See W. H. Young, Quarterly Journal, Vol. 35 (1904), p. 190. 
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For those values of x for which both f(x) and $(x) are continuous, 
F(z) is also continuous as a consequence of Theorem II, Art. 24, and 
the definition of continuity. The only points of discontinuity that 
F(x) can have are those points for which either f(x) or @(zx) or both, 
are discontinuous. As f(z) and ¢(z) are both integrable, their points 
of discontinuity form sets of measure zero and hence by Theorem VI, 
Art. 21, those of F(x) must also have the measure zero, since the 
measure of the points of discontinuity of F(x) can not exceed the sum 
of the two sets of measure zero having no points in common, namely 
the discontinuities of f(x) and those of $(x) not points of discon- 
tinuity of f(z). It follows that F(x) is integrable in (a, b). 

TueoreM VI. Jf f(x) is bounded and integrable in (a,b), then 
| f(x) | ts integrable in the same interval and 


| [eae | = f17@) | ax. 


We shall first show that the integral in the second member of this 
b 
inequality exists if the integral [ f(x)dzx exists. By comparison we 


see that the oscillation of | f(x) | in any interval is less than or at 
most equal to that of f(z). By Theorem II, Art. 39, we have 


L QQ. f, ab] = 0, 
A-0 


where Q, = > w,, Az(x). 
k=1 


But since the oscillation of | f(x) | can not exceed that of f(x) in any 
subinterval A;(x), it follows that the oscillatory sum Q,’ formed for 
| f(z) | must be equal to or less than 2. Consequently, we have 


LQ/ =0, 
A-0 


b 
and the integral if | f(x) | dz must also exist. 


From the definition of a definite integral, we have 
b n 

Jf tarde | = 1,0, 3 GA) | 
b n 

fo ls@ lac = 2° 3 1 Feo | Ano. 


But since the absolute value of a sum is less than or at most equal to 
the sum of the absolute values, we have for all values of A, and hence 
for all values of n, 


| 2 EA) | s E17) | Aa). 
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Passing to the limit as A approaches zero, we have 


Jtede | s ["@) lar, 


which establishes the theorem. 

The converse of this theorem is not true; that is, | f(x) | can be He 
grable even when f(x) is not ra Seats For example, if f(a) is $ for 
all rational values of x and— for all irrational values, the ea 


a 
| f(x) | dx exists although aa integral f, f(x)dx does not exist, 
0 


ange | f(x)| is continuous while f(z) is totally discontinuous. 


TurorEeM VII. If f(x) and ¢(x) are bounded and integrable in the 
interval (a, b) and if | f(x) | S | d(x) | for all values of x in (a, 6), a 


follows that ; a 
fr@ae | s [1 @ lar. 


From the condition 


lf) lel ¢@)I, 
it follows that each term entering into the summation defining the 
b 
integral if | f(x) | dx can not exceed the corresponding term in the 


summation defining the integral alle | d(x) | dx, and hence 


190) ae s [| o@) | ae. 


But by Theorem VI, we have 
6 
s ["\s(e) | ax. 


| f toa: 


By a comparison of these two inequalities, it follows that 


[tear | = J°1e@) Lae, 


as the theorem states. 
Turorem VIII. If f(x) is a bounded, integrable function in the 
interval (a,b), then 


m(b — a) a, f(x) dx < M(b - a), 


where m and M are respectively the greatest lower and the least upper 


bounds of f(x) in (a, 6). 
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We have at once from the conditions of the theorem 
zm 4p 2 1G) Aue s 2 MA. 


Passing to the limit as the norm Az approaches zero, we have from 
the definition of an integral 


~ fare reat aa 


or m(b — a) sf. f(z)dx = M(b - a), 


which is the desired result. This result is called the First Law of the 
Mean for the integral calculus. 
There must be some intermediate number mw between m and M 


such that 
[s@dz = ue - a). 


If f(x) is continuous and therefore takes all values between m and M, 
it follows that there must exist some point 2 in the interval (a, 6) for 


hi 
Nae: ft) = a. 
We have then the following theorem. 


TuroreM IX. [f f(x) is continuous in the closed interval (a, b), then 
there exists at least one point x» in this interval for which 


J Tear = sles) @ - 0). 


By a similar argument we can prove the following theorem. The 
details of the proof are left to the reader to supply. 


THEOREM X. If (x) 2s continuous and f(x) is a bounded, integrable 
function and non-negative for all values of x in the interval (a, b), then 
at least one point x9 can be found in this interval for which we have 


J i@d@d = $e) ['Fede. 


The following theorem gives a relation known as the Second Law 
of the Mean for the integral calculus.} 


1 This form of the Second Law of the Mean is due to Bonnet, see Liouville’s 
Journal, Vol. 14 (1849), p. 249. 
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THEOREM XI. Let f(x) be bounded and integrable in the interval 
(a, b) and suppose (x) to be a non-negative, bounded, monotone de- 
creasing function. Then there exists a value & such that 


b s 
[s@e@dr = $@ [fede as Eso. 
It follows from the conditions of the theorem that $(z) is integrable 
_and hence that the product f(x) - (x) is integrable by Theorem III of 
ONS 40. The integral ie f(x) $(x)dz is the limit, as the norm A of the 


intervals Ayr = (a; — 2,1) approaches zero and consequently n be- 
comes infinite, of the sum 


2 f (us) O(e4) (te — Te1), (1) 


where 2% = a, t, = b. For convenience put 
FG) (Xi = teen) = Ne-1) 
b(te-1) = hea, Wo +Mt-: > > th, =An 
The sum (1) may then be written 
E f(s) (ars) (#e—tea) =Rohot iit dabst + + -+An abet 

k=1 

=(Aohot Aidit Aohet: + -+AniPa-i) 

—(Aodit Aigot: + -+An-2bn—i) 

n—1 

= 2 Ax-1(Pr_1— Px) +An1Pn—1- (2) 
Denote by @ the largest and by B the smallest of the numbers 
Ao, Ai, * + *, An-1. The above summation would be increased should 
we replace Az: by @ and it would be likewise decreased if we replace 


Aj. by B. By making these substitutions, the right-hand member 
of the above equation becomes either 


a (ns - $s) + boa} = ado 


k=1 


= B| "S! (us ~ $s) + bos} = Boo 


k=1 


Consequently, we have from (2) 


Bodo = > if (a1) P (Lr-1) (tp — Le-1) S Aho. 


k=1 
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Recalling the values of a and of 8, we can now say that, upon eS 
to the limit as A approaches zero, the integral 


J f@o@a: (3) 


lies between the least upper and the greatest lower bounds of 
(a) ifs Fre) en wherea SXSb. Since-the integral F(X) = ip A soe) de 
is a continuous function! of X, then F(X) takes all values between 
its least upper and its greatest lower bounds. Consequently, there — 
is some value of X, say X = &, for which F(X) is exactly equal to 
the integral (3). We have then 


[i@o@ar = $@ iE fla)da,a s&s 


as the theorem states. 

In the foregoing proof, we have placed upon ¢(«) the restric- 
tion that it shall be a bounded, non-negative, monotone decreasing 
function. If (x) is a bounded, non-negative, monotone increasing 
function, we can by a similar argument show that 


[i@o@dx = $(b) ae (ace: Gets th, 


Another form of the foregoing theorem has been given by 
Weierstrass and Du Bois Reymond,’ namely: 


[1oo@ae = 60) [Faddx + 60) f'7@dz,as Es. 


It is to be noted that this second Law of the Mean holds even if f(x) 
is not bounded but merely any integrable function.* 

Let us consider what changes, if any, need be made in the law for 
the change of variables in order that it may hold for the class of 
bounded, integrable functions. In this connection we shall prove 
the following theorem. 


TuroreM XII. Let f(x) be bounded in the interval (a, b) and sup- 
pose x = p(t) to be a monotone, continuous function of t in the closed 
interval (a, 8), where a = (a), b = (8). Then, if Do(é) denotes any 


1 Theorem I, Art 41. 

2 See Crelle’s Journal, Vol. 49 (1869), p. 81. 

* Compare Pringsheim, Miinch. Ber., Vol. 30 (1900), p. 218; Hobson, Lon- 
don Math. Soc. (2), Vol. 7 (1908), p. 14. 
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one of the derivative numbers of (t) and if it is bounded and integrable 
in (a, 6), we have _ 


['@a - [oO] Dou, iO 


b B 

[ted = [ool Dewat. () 
We shall prove (a); the proof for (6) is similar and | can be readily 
supplied. Since f(x) is bounded, the upper integral ef (x)dzx exists. 
As $(¢) is continuous in (a, 8) and f(z) is bounded, f[(t)] is bounded. 
D¢(t) is bounded by hypothesis. Consequently, the product 
fL¢(t)]-D@(t) is bounded and its upper integral also exists. We 

need to show the equality of the two limits 


L8.= Lb oOMAu, L S;= L > M Ait, 
Ar—0 At—0 At->0 


Az—0 
where M, = Maz f(x) in Ayr, M; = Maz fl o(t)]-Dd(é) in Aut. 
As x = $(é) is a continuous function, A,xz approaches zero whenever 
A,t approaches zero. 

As we have seen, the least upper and the greatest lower bounds of 
the derivative numbers are the same and also the same as the least 
upper and the greatest lower bounds of the difference quotient. For 
convenience, put 


Fi) = SO — 2M), ees 


Denote the least upper and the greatest lower bounds of F(t) in any 
interval A,t by ux and Xz, respectively. From the integrability of 
D®¢(t), it follows that by a proper choice of the norm At we have 


Z(ux— An) Aut <e, 


where € is arbitrarily small. 
We have also the relations 


M, = Maz fl b(t) ]-Az = M,Nuy 
P(t) — P(r) Ait 


Aye = 24 — %-1 = Rear 
k k—1 

Then we have |S.-—S,| =| 2 MzAe —- 2 M.Ait | 

| >; Mb Axt _ D2; M,N Ant | 
| > M.(pux — rx) Art | 

< Mas | f(x) | Z(us—dx) Act 


< Maz |f(x)|- esa, 


IA WA | 
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where €; is an arbitrarily small positive number, and Maz | f (a) |is 
the least upper bound of | f(z) | in (a, 6). Consequently, as the norm 
At, and hence Az, approaches zero we have 

DAW See S:he0 


At>0 
and therefore i tx) de = ifs Br b(t) |Do(t)dt. 


We can now establish the following theorem: 


TuroreM XIII. Let x = h(t) be a monotone continuous function 
of t in the closed interval (a, B), where a = b(a), b = (8). Then af one 
of the derivative numbers D $(t) is integrable in (a, B) and if either of 


the integrals b p 
fi@e, [reo Dsoae (a) 
exists, the other also exists and the two are equal. 


From Theorem XII, we have 
[sexe = [PLeoIsoue () 


J i@a = [Prom pewa () 


By hypothesis, one of the integrals in (a) exists, and hence either the 
left-hand or the right-hand integrals in (b) and (c) are equal. It 
follows that the remaining upper and lower integrals in (6) and (c) 
are equal and the theorem follows. 

If the derivative $’(t) exists for each value of ¢ in (a, B), then of 
course the derivative number D¢(t) exists. Moreover, if $/(t) is 
finite, continuous and different from zero at each point, then (¢) 
is monotone. Hence, we have the following corollary. 


Cor. Let f(x) be a bounded, integrable function, and suppose 
x = P(t) to be a continuous function of t having a finite, continuous de- 
rivative different from zero at all points of the closed interval (a, B). We 


may then write Ap 
J teas = [iol 6" at 


The foregoing theorems involve the condition that $(t) be a 
monotone function. If it is not, the given interval can often be 
broken up into subintervals where this condition holds and thus the 
application of the theorems extended. 
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41. Indefinite integrals. Suppose that f(x) is bounded and inte- 
grable in the interval (a, 6). Then by Theorem I of the last article, 
the integral | f(x)dx exists, where x is any intermediate value be- 


tween a and b. This integral is called the indefinite integral and 
defines a function of . We may write 


(0) = f “Fe)ae. 


The indefinite integral is often written He f(x)dx without indicating 


the limits of integration. The indefinite integral has certain proper- 
ties as expressed in the following theorems. 


THEOREM I. Jf f(x) is bounded and integrable in the interval (a, 6), 


th z 
i (0) =f Feaddx 


ts a continuous function of x in this interval. 


By giving to x an increment Az we have 


(0 + An) - o(2) =f fedae — [Hoax 


a+Az 
= { Fe)ae. (1) 
We have by the first Law of the Mean 
at+Az 
HE i@ds \ a M-Ac. (2) 


where M is the least upper bound of | f(z) | in the interval (x, x + Az). 
From (1) and (2) we have 
| h(a + Ax) — p(x) | Ss M-Az. (3) 


eee 
We may put VSay’ 


where € is an arbitrarily small positive number. For all values of Ar 
smaller than 4, we then have 

| $(@ + Az) — oz) |<e, 
which shows that (x) is continuous at each point x in the interval 


(a, b). 
A similar argument shows that the upper and the lower integrals 


[r@e, [ree 


are also continuous functions of 2. 
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The question naturally arises as to the conditions under which 
$(z), as defined by Theorem I, has a derivative and, if it does exist, 
what its relations are to f(z). In answer to this question we have the 
following theorem. 


Turorem II. If f(x) is bounded and integrable in the interval (a, 6), 
then (x), defined by the relation 


o(a) =f sede, 


a 


has a derivative at each point xo of (a,b) where f(x) ts continuous. 
Moreover, we have do 


se | a 1G) 


Since 2 is a point of continuity of f(x), it follows that for every 
positive value of € however small there exists a 6 > 0 such that we 


oe | f(a) — far) |< €,|a - | < 6. (4) 
From the definition of d(x), we have ‘ 
(20 + Az) ~ gle) =f" fade. (5) 


In the interval (2 — 6, x) + 6) the least upper bound of f(x) is less 
than f(x) + €, while the greatest lower bound is greater than f(a) — €. 
Hence, from Theorem VIII of the previous article, we have for all 
values of | Ar | < 6 


xotAz f 
Az [ f(a) — €] sf f(x)dx = Ax[ f(a) + €]. 
By aid of (5) we may then write 


Az | f(xo) — €] S Lb(ao + Az) — (x) ] = Ar[ f(a) + €], 


whence {Go ers hn ae = f@o) He. 


The first and last terms of this inequality approach the same limiting 
value f(x) as 6 approaches zero. But Az approaches zero with 6. 
Hence, by Theorem IV, Art. 24, the following limit exists, namely we 


have 
p $+ Ax) = 6%) _ 4, 


x) 
Az—0 Ax 
But this limit is nothing else than the derivative of }(z) at the point 
Xo, and therefore we have 
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In a similar manner it may be shown that if f(«) is continuous at 
any point 2 of (a, b), then the integrals 


fF sera, [" seae 


define functions, each of which has a derivative at 2p. 
If f(x) is continuous throughout the interval (a, b), then we have 
as a consequence of this theorem the following corollary. 


Cor. If f(x) is continuous in the closed interval (a, b), we have 


(2) -{ J()da.6 Ses 0, 
where, for all values of x in (a, b), we have 
dg 
dx =; f (x) ? 
that 2s, every continuous function is the derivative of some other function. 


It follows from the foregoing theorem that the points at which an 
indefinite integral ¢(x) can fail to have a derivative form at most a 
set of points of measure zero; because, these points must be points 
of discontinuity of the given function f(x), which is by hypothesis a 
bounded, integrable function. 

In case f(x) is bounded and integrable in (a, b), but has points of 
discontinuity, the right-hand derivative and the left-hand derivative 
of d(x) exist and are equal respectively to f(x + 0) and f(x — 0). 
The proof of this statement follows the same line of argument as 
that for the proof of the foregoing theorem and is left for the reader 
to supply.! 

A function F(x) which has f(x) as its derivative for all values of z 
in the interval (a, b) of integration is called a primitive of f(z). Any 
other function which differs from F(x) by only an additive constant 
is also a primitive of f(x), since its derivative is equal to f(z). If 
the indefinite integral ¢(x) has a derivative such that 


dd 
dz = f(z), 


then (z) is a primitive of f(z) and we have 
F(z) = $(@) +. 
1 See Encyclop. des Sct. Math. Iz, p. 199. 
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This is always true if f(z) is a continuous function, in which case 
we frequently omit the limits of integration and write 


[i@de = F@) = 6@) +6. 


If f(z) has points of discontinuity but is bounded and integrable, 
the same statement can not always be made. It may happen, for ex- 
ample, that the indefinite integral @(x) may exist and yet there may 


be values of x for which the derivative a does not exist. It may 
dx 
also happen, as we shall see, that 


dF 
de 71%), 45256 


and yet f(x) be not integrable in the interval (a, b). 

In Arts. 29 and 31 we have discussed briefly the properties of the 
derivative numbers of a function f(x), represented by D*f(«), D.f(a), 
D-f(x), D_f(x), respectively. We shall now consider some of the 
relations of these numbers to the indefinite integral. 


TueorEM IV. Given any function $(x) which is known to be con- 
tinuous in (a, b) and suppose that one of its derivative numbers is bounded 
and integrable in (a, b), then the other derivative numbers are also bounded 
and integrable. Moreover, for any value of x in (a, b) we have 


$2) - g(a) = f “Dear = [“D,6(@)a 
= i) "D-$(2)dx = f "D_o(2)de. 


By the insertion of the intermediate points 2%, 22, - + + %n-1, 
let the interval (a, x) be divided into subintervals. For convenience 
put 

Aye = t > tra, k =A, 2,3, - + +n, where a = %, + = 2,. 
Denote by Dd(x) that derivative number which is known to be inte- 
grable in (a,b). Then by Theorem VI of Art. 31, it follows that 
(xx) — b(xx-1) lies between the least upper and the greatest lower 
bounds of A.«Do(x). If we denote the least upper and the greatest 
lower bounds of Dd(x) by M and m, respectively, then we may write 


mA S b(rx) — b(n) S MpAze. 
By taking the sum of all such products for the interval (a, 2), we have 


2 mix S (2) — (a) S = M, Aww. (7) 
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From the fact that the one derivative number is known to be bounded 
and integrable, it follows that the limits of the first and the last 
terms in (7) must lead to the same limiting value as the norm A 
of the Axzz’s approaches zero and hence n increases indefinitely 
(Theorem IV, Art. 24), namely the integral of the given derivative 
number. As the inequality holds for all the derivative numbers of 
g(x), we have he general conclusion desired, namely 


$02) - $(@) = [“Dro@dr = ["D.o(@)ae 
» i 'D-6(2)dz = ff “D.ot)de. 


If we have 


D*$(x) = Di $(z) = D-$(x) = D_-d(2) = f(a), 
the function $(x) is a primitive of f(z). We then have as a special 
case of the foregoing theorem the following corollary, known as the 
fundamental theorem of integral calculus. 
Cor. 1. If in the interval (a,b), f(x) ts bounded and integrable and 


of there exists a function F(x) such that — = f(x) for all values of x in 


(a b), then : - 
[sede = F(x) — F(a). 


If any one of the derivative numbers D@ exists and is equal to 
f(x), we have also the following corollary. 
Cor. 2. If (x) is a continuous function having a derivative number 
D(z) equal to f(x) for all values of x in the interval (a, b), then 
o(2) — 6a) = f ‘fle)de. 


If in the foregoing theorem the given derivative number Dd(z) is 
bounded but not integrable, it still follows that the upper and the 
lower integrals of D@(x) exist, and we have the following theorem. 


TueorEeM VY. Given a bounded, integrable function f(x) having the 
indefinite integral ‘ 
o(2) = f “Fe)de. 


Then, if D(x) is any one of the derivative numbers of (x), it follows 


that ase 3 
ip *Ddb(a)dx = (2) — O(a) = Af Do(x)dz,a <x Sb. 
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This theorem follows as an immediate consequence of (7); for, 
that inequality still holds even if D@(z) is not integrable. If, how- 
ever, it is bounded, then the upper integral and the lower integral 
both exist and we have in the limit the desired result. 

As a specia] case, the foregoing results hold if @(x) has a deriva- 
tive; that is, when the derivative numbers of @(x) are equal. We 
have then the following corollary. 


Cor. If (x), defined by the indefinite integral 
o(2) =  ‘F@)az, 


has a derivative for each value in the interval (a, x), then 
[Baez o@) - ae ©? as. 


If we have given o(x) = ile f(x)dx 


and 4 2 exists at every point in (a,b), it does not follow that ¢(2) is 
cea a primitive of f(x), but from the foregoing discussion we 


see that =e can differ from f(x) at most at a set of points of measure 
zero. 

The foregoing theorems lead us to certain important conclusions 
as to the relation of differentiation and integration. For the simple 
functions considered in elementary calculus, they are inverse opera- 
tions. If we include all functions to which these two processes 
apply, we shall see that they are not always the inverse of each 
other. It is desirable to see under what conditions they may be so 
regarded. Suppose we have a function (x) defined by the relation, 


bCays if ON Ge een (8) 


The proposed problem involves the conditions that the given integral 
shall exist and that we shall have 


j(o) = 58. (9) 


Conversely, it involves the condition that a given function F(z) 
shall have at each point of (a, 6) a unique derivative such that this 
derived function shall have the given function F(x) as an indefinite 
integral. 
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Let us assume f(x) to be a bounded, integrable function. From 
Theorem II it follows that at each point of continuity of f(x) the 
relation (9) exists. If f(x) is continuous throughout the interval (a,b), 
it follows that f(x) is the derivative of the indefinite integral for all 
values of x in (a,b). In other words, differentiation is in this case the 
inverse of integration. However, if we assume merely the existence 


of the indefinite integral ik t (x)dx, rather than the continuity of f(z), 


it defines a continuous function (x) whose derivative is the given 
function f(x) for all values of x with the exception of at most a set 
of points H of measure zero. The points of H where the inverse 
operation, namely differentiation, fails are points of discontinuity of 
J(x). As the integral of f(x) exists, the points of discontinuity of f(z) 
where the saltus exceeds an arbitrary number 7 can not be in any 
subinterval of (a, b) everywhere dense, and consequently by Theorem 
III, Art. 28, f(z) can be at most point-wise discontinuous. It fol- 
lows then from Theorem IV, Art. 28, that the points at which dif- 
ferentiation may be regarded as the inverse of integration must form 
a set having the cardinal number of the continuum. The points Z 
where the operation of differentiation fails must be a set of at most 
measure zero. As we have seen, a set of measure zero may be every- 
where dense, as for example the rational numbers. Such a set may 
even have the cardinal number of the continuum. In Art. 20 we 
formed a set having this property. At all of the points of E the 
function ¢(x) is continuous by Theorem I, but as we have seen it 
fails to have a derivative or, if it does have one, that derivative may 
be different from f(x). It is important to note that if a given func- 
tion f(z) is integrable in an interval (a, b), then the indefinite integral 

“f(x)dz, a <2 Sb, can not fail to define a function ¢(x) which is 


a 


continuous in (a, 6) and has points in every subinterval, however 
small, where its derivative is equal to f(z). 

Let us now consider the inverse problem. Suppose the function 
F(a) has a derivative f(x) at each point of a given interval (a, b). 


Does the integral ie 7 (x)dx exist and give F’(x) except for an additive 


constant? From the existence of the derivative at each point of 
(a, b), it follows that F’(x) = f(x) is at most point-wise discontinuous. 
In order that F’(x) should satisfy the conditions of integrability it is 
necessary that it be discontinuous at most at a set of points of ° 
measure zero. Such a function need not exist. 
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Volterra has given the following illustration 1 of a function having 
a bounded derivative at every point of a given interval (a, b) where 
this derived function does not satisfy the conditions of integrability 
in the Riemann sense. 

Let E be a perfect set of measure greater than zero in the interval (a, b) but 
in no portion of it everywhere dense. There must then be in every subinterval 


a portion which is free of points of H. Let (a, 8) be any one of those subintervals 
complementary to the set H. We shall make use of the function 


g(x, @) = (x — a)* sin »for 2 # a, 


Z-—a 
= 0, forr=a. 
Differentiating, we have 


1 
— cos »forz # a, 
r-—a 


vg! (x, @) = 2(x — @) sin 


= 0, forr@ =a. 


The derived function g’(z, a) has an infinite number of zeros in the interval 


a, ocr , and these zero points are dense atz =a. Let a+ vy be the largest 
value of x for which g’(z, q@) is zero in | a, = _ B We shall now define f(x) as 


follows: 
f(x) =¢(, a), fora <a Sa+y 
=~ +7, a), foray Ses By (10) 
= (x, B), for B-ysx<B 
= 0, for all points of £. 


It follows that f(x) is fully defined and continuous in the interval (a, 6). Since 
E is a perfect set it must include its limiting points, and hence a, 8 belong to E. 

At each point x of # the derivative f’(x) is zero, as we shall see. Form the 
difference quotient 


flee + Az) — foo) 


Ax 


As xo is a point of H, f(zo) is zero. If xo + Az is likewise a point of HZ, then 
f(ao+Az) isalsozero. If, on the other hand, xo + Az is a point of the complemen- 
tary set C(), then f(x + Az) takes the values given in (10). In any case, the limit 
of the difference quotient as Az approaches zero is zero. Consequently, for each 
point of # the derivative is zero. By Theorem IV, Art. 17, it follows that every 
point of # is an a-point or a B-point or the limit of such points. Since this is the 
case, each point of # is a point at which f’(x) is zero but in the neighborhood of 
which this derived function oscillates between + 1 and —1. Each point of # 
is therefore a point of discontinuity of f’(x) having the saltus 2. As E has by 
hypothesis a measure greater than zero, f’(x) can not be integrable in the Riemann 
sense. 


1 See Giornali de Mat. (1), Vol. 19 (1881), pp. 333-72; also Encyclop. Sci. Math. 
IL2, p. 195. For another illustration, see Hahn, Monatshefte fiir Math. und Physik. 
Vol. 16 (1905), pp. 161-166. 
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From this illustration it follows that integration is not necessarily 
the inverse of differentiation if we place no farther restriction upon 
the derivative than its existence. 

If we assume that the derivative function 


F'(x) = f(@) 


is bounded and has only ordinary finite discontinuities in the given 


x 


interval (a, b), then the indefinite integral if f(x)dx exists and is equal 


a 


to F(x) except for an additive constant; that is, integration is then 
the inverse of differentiation. For, from Theorem VIII of Art. 39, 
it follows that the integral ui f(a) dx exists for all values of x where 
as=x2b. As we have seen,! the right-hand derivative and the left- 
hand derivative must exist in this case at each of these points of dis- 
continuity and must be equal to f(« + 0) and f(x — 0), respectively; 
that is, they must be equal to F’(x +0), F’(x—0). But as F’(z) 
exists at each point of (a, b), these two values are the same. Con- 
sequently, under the conditions stated, it follows that integration is 
the inverse of differentiation. 

In case a function F(x) has a continuous derivative in (a, b), it 
follows from the foregoing discussion that this derivative is integrable 
and that integration gives the original function as the inverse opera- 
tion requires. 

The only case where a given derived function F’(x) can fail to 
have an indefinite integral which differs from F(x) at most by an 
additive constant, that is the only case where integration fails to be 
an inverse operation to differentiation, is where F’’(x) has points of 
discontinuity in every neighborhood of which F’(x) has an infinite 
number of oscillations. The example given above is an illustra- 
tion. As a matter of fact, a continuous function F(x) which oscil- 
lates everywhere can not have a derivative function D f(x) which is 
integrable. For, in any subinterval, the least upper bound of the 
derivative numbers will be positive while the greatest lower bound 
isnegative. Consequently, if we find the limit which defines the 
upper integral of the derivative function, it is positive while the limit 
defining the lower integral is negative. As the upper and the lower 
integrals can not be equal in any subinterval (a, x), it follows that 


the indefinite integral | f(x)dzx can not exist. 


1 See remarks following Theorem II of this article. 
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42. Definition of infinite integrals. Thus far we have discussed 
integrals of bounded functions over a finite interval. We shall now 
consider what extensions may be made to cases where either the 
integrand becomes infinite at certain points or one or both of the 
limits of integration become infinite. In contradistinction to those 
integrals already discussed, we shall designate this new class of 
integrals as infinite integrals. As we shall see, they appear as limiting 
cases of finite integrals. 

Let us suppose that f(x) has an infinite discontinuity at a point 
2 in the interval of integration (a,b), and that at all other points of 
(a,b) f(z) is bounded. We can exclude the point xo by inclosing it 
in a small interval (a )—€,,%0+€2) where €,€: are arbitrarily chosen. 
In the remaining portion of (a,b), f(x) is bounded, and the two in- 


tegrals ro—€1 *% 
JO F@a, fo sae 
a tot€2 


exist under the conditions set forth in the foregoing articles. The 
above integrals are functions of €, €2, respectively, and it may happen 
that the two limits 


Zo—€1 6 
Lf” Yada, Lf sede (1) 
a0 Va €2—0 e/ Lot €2 


both exist. In this case we call the sum of these limiting values the 
infinite integral ! of f(x) taken over the interval (a, b) and denote it 


by the symbol » 
i f(a)dz. 


It is essential to notice that €, €: are independent of each other. 
If this were not so, it would be possible for the sum of the two inte- 
grals in (1) to have a limit although each limit might not exist. For 


example, consider the integral of 5 over the interval (— 1,1). This 


function becomes infinite at = 0. If we put & = €2 = €, we have 


—eE 1 
LS LEI aE HS-140-B} om 
60 -1 v e & «30 2\€ ée 
1 Infinite integrals are sometimes called improper integrals. The term infinite 
integral was first introduced by Hardy (see Proc. London Math. Soc., Vol. 34 
(1901), p. 16). This term is very suggestive in that it points out the distinc- 
tion between these integrals and finite integrals (definite integrals) in much 
the same manner as we distinguish between infinite series and finite series. The 


use of the term convergence of infinite integrals is also suggestive of the same 
analogy. 
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However, neither of the limits 
—€} 1 
a ea {3 
a0 J—-1 e0de2 & 
1 
exists, and consequently the integral if . can not pe said to exist. 


If the limit pal J et age He foe | 


exists, where we have put € = €2 = €, the result was called by Cauchy 

the principal value of the integral. It will be seen from the foregoing 

illustration that the principal value may exist without the infinite 
6 

integral | f(x)dz existing. 

The definition of an infinite integral can be extended at once to 
the case where f(x) has a finite number of points of infinite discon- 
tinuity. Let ci, cz be any two such points which are consecutive. 
In the interval (¢ + €:, C2 — €2), f(x) is bounded and let us suppose 
it to be integrable; that is, the integral 


Co—€2 d 

ate, {nde 
exists. We then say that the infinite integral af f(x)dx exists if the 
limit Ls 


90 Jatea 


exists. If in each of the divisions of (a, b) made by the points q, Cs, 
¢3,° * *, Cn of infinite discontinuity the corresponding limit exists, 


b 
then we say that the infinite integral | f(x)dz exists. 


It will also be seen that this definition can be extended to the case 
where the set E of points of infinite discontinuity is such that 
the derived set EH’ consists of a finite number of points.” For, let 
a, B be any two consecutive points of H’. Then in the interval 
(a + €, 8 — €) there can be only a finite number of points of F, 
and, as we have seen, the definition can be extended to such cases. 


If the infinite integral Des 
pa! (x)da 


1 For a discussion of the properties of the principal values of an infinite 
integral, see Hardy, Proc. London Math. Soc., Vol. 34 (1902), pp. 16-40, also pp. 
55-91, and Vol. 35 (1903), pp. 81-107. 

2 Due to Dirichtlet. See Lipschitz, Journ. fiir die reine und angewandte Math., 


Vol. 63 (1864), pp. 296-308. 
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exists also for the interval between each consecutive pair of points 

a, B of E’ and has a definite limit as €, € approach zero, then the 
‘> 

infinite integral J f(x)dz is said to exist. 


As an illustration of such a function, we have 
AC ese, Oren -te<als 


which has an infinite discontinuity at a set of points H dense at the 
one point x = 0; for, writing 


1 1 
csc — = 


? 

Sint 
: 1 

we see that the points H are those where sin - has zero points. The 


derived set EH’ consists of a single point, namely x = 0. 

We may well question how far the set H of infinite discontinuities 
may be extended and still preserve the essential characteristic prop- 
erties of finite integrals. For example, it is desirable that the indefi- 
nite integral should be uniquely determined except as to an additive 
constant in every subinterval where the integrand is bounded and 
integrable; moreover, it is also desirable that the indefinite integral be 
continuous and satisfy the fundamental law of the integral calculus. 

We may therefore state the definition of an infinite integral of 
non-bounded functions as follows. Given a function f(x) having a 
set E of infinite discontinuities in the interval (a, b), we say that f(x) 
is integrable in (a, b), if there exists in (a, b) a continuous function 
(x) which is uniquely determined, except as to an additive constant, 
satisfying the relation 


JC s@az = (0) - $(e0) ) 


for every subinterval (xo, 2) of (a,b) in which f(z) is bounded and 
integrable.! If these conditions are satisfied, f(x) is said to be the 
indefinite integral of f(x), and we write 


fs@)ax = $(t) - d(@),a =x = 0b. 


1 See Holder, Math. Ann., Vol. 24 (1884), p. 192; also Lebesgue, Lecons sur 
Vintégration, p. 13. Other definitions of integrals of non-bounded functions are 
to be found in the literature. See Hamach, Math. Ann., Vol. 21 (1883), p. 34, 
Vol. 24, p. 220; de Vallée Poussin, Jour. de Math. (4), Vol. 8 (1892), p. 427; 
E. H. Moore, Trans. Amer. Math. Soc., Vol. 2 (1901), p. 459; Pierpont, Real 
Variables, Vol. 2, p. 30. 
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In order to state the conditions under which f(z) shall satisfy this 
generalized definition, it is convenient to introduce what has been 
called a reducible set of points, by which is understood such a set E 
that some one of the derived sets 

E', E"",- + +, EM,. . ., Be) 
contains only a finite number of points. Such a set is enumerable 
by Theorem VIII of Art. 15. Without some qualifications as to the 
character of the set, the converse is not true. For example, the set of . 
rational numbers is enumerable, but it is not reducible. We may 
now state the following theorem. 


THEOREM I. In order that f(x) be integrable in the interval (a, b), it 
as necessary and sufficient that the points of infinite discontinuity form a 
reducible set and that there exists a continuous function o(x) which, in 
every subinterval (Xo, x1) where f(x) is bounded and integrable, satis- 
fies the relation (1). 


In order to show that the foregoing conditions are sufficient for the 
integrability of f(x), it must be shown that throughout the interval 
(a, b) the indefinite integral (x) may be uniquely determined, except 
for an additive constant, if the points of infinite discontinuity form 
a reducible set H. We have already seen that (x) may be uniquely 
determined, except as to an additive constant, if H consists of a finite 
number of points and likewise if HE’ consists of a finite number of 
points. 

If the second derived set #’’ consists of a finite number of points, 
the same conclusion can be reached for those subintervals free from 
points of #”’. Let c, c: be any consecutive points of #’’. Then in 
the interval (c; + &, C2 — €:), f(x) is integrable and (x) is uniquely 
determined, except for an additive constant, since, as we have seen, 
it is true for intervals where H’ consists of a finite number of points. 


Moreover, the limit L (2-4 

40 f(x)dx 

6 07a +4 
must exist because #(z) defined by this integral is a continuous func- 
tion in the closed subinterval (c, c2). It follows in this case that p(x) 


is uniquely determined, except as to an additive constant, throughout 


b 
the interval (a, b) and the integral { f(x)dx satisfies the definition 
of an infinite integral. In a similar manner, it can be shown that 
(x) is uniquely determined, except for an additive constant, if any 
finite derived set EH) consists of a finite number of points. 
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Finally, let us assume that H®) consists of a finite number of 
points, of which c, c. are any two consecutive ones. It is then pos- 
sible to find a value of n , such that in the interval (ci+€: , @—€2) the 
derived set Z™ consists of a finite number of points. In this interval 
the integral of f(x) exists and defines uniquely, except as to an additive 
constant, an indefinite integral ¢(z). From the fact that this con- 
clusion holds for every closed interval free from points of H@) and 
from the assumed continuity of }(z) in these intervals, it follows that 
f(z) satisfies the definition of an infinite integral in the given interval 
(a, b). 

These conditions are also necessary; for, if f(x) is integrable in 
accordance with the definition given, then $(x) is uniquely determined, 
except for an additive constant, in any subinterval of (a, b) which is 
free of points of # and is continuous throughout the interval of inte- 
gration. Moreover, we have seen that the set H can be reducible 
for an integrable function, and the following illustration will show 
that, in case it is non-reducible, the indefinite integral (x) is not 
necessarily uniquely determined. 

The indefinite integral @(x) can be determined even though the 
set H of infinite discontinuities is not reducible; in fact, even if it is 
a perfect set. However, under these circumstances $(x) is not neces- 
sarily uniquely determined except as to an additive constant. To 
show this, let EH be the perfect set discussed in Art. 17 formed by 
dropping out the middle third of successive free intervals. Let f(x) 
be equal to x in all points of the interval (0, 1) except at points of Z, 
where we assume that f(x) has an infinite discontinuity. Since H isa 
closed set of measure zero, it is also of content zero and hence can be 
inclosed in a finite number & of intervals, each of arbitrarily small 
length, say equal to e«. We then have 


(x) = | ‘Hoa = Lea —ke) =*,0 S231. 


We shall now show that (zx) is not uniquely determined except 
for an additive constant; that is, we shall show that it is possible to 


define for the interval (0, 1) a function F(x) such that $(2) + F(z) 
is continuous in (0, 1) and 


QO 8 by de likewise satisfies (1) in any 
eee 4. Fite subinterval of (0, 1) not con- 
Fia. 33. taining points of H.4 Let 


1 See Lebesgue, Lecons sur l’intégration, p. 13. 
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F(O) = 0; FQ) =1; 

F(x) = 4, for x in the open interval 6,; 
= 4, for x in the open interval 52, if 0 < 6. < 4; 
= 4, for x in the open interval 4, if 6, < 62 < 1; 


2 LF(6,) + F(6,)], 
where 6,, 6; are the two intervals of the sequence 
61, bo, 63, el a Ox—1 


which lie on opposite sides of 6;. All points of E are end-points of 
the 6-intervals or are the limiting points of these end-points. As x 
approaches any one of the points of £, the values of F(x) approach a 
definite limit, which we assign as the value of F(x) at those points. 
Thus F(x) is fully defined in the interval (0,1). It is continuous 
throughout this interval but is not a constant for all values of x in 
the interval. It is, however, a constant in any subinterval 6 not 
containing points of HZ. The function w(x), where 
V(x) = F(x) + $(), 

is then continuous in (0, 1) and satisfies the relation (1). It follows 
that if the set # of infinite discontinuities is non-reducible, the 


indefinite integral @(x) is not necessarily uniquely determined, ex- 
cept as to an additive constant, in those subintervals not containing 


points of L. 
Since every reducible set is enumerable and hence of measure zero, 


it follows from the foregoing theorem that the points of infinite 
discontinuity of a non-bounded, integrable function can at most form 


a set of measure zero. 
If one of the limits of integration is infinite, then the infinite 


integral i “4(x)de is said to exist, provided the limit 
L | f(x)de 


exists, and the integral is defined as that limit. A similar statement 
can be made when the lower limit of integration is infinite. If both 
limits of integration are infinite, then, in order that the infinite integral 


ai “ f(x)dx may be said to exist, it is necessary that the two limits 
L ur eae if “sade 
F re AOe) 7 roe 100) a 


shall exist. 
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‘ foe) dx 
Ex. 1. Evaluate the integral 4; 1-2 
We have 
is dx Zz dx us us T = un 
J oe oe eotane 3) = 9-4-4 


Ex. 2. Test the existence of the integral if. © sin x dz. 
We have ne snade= L (*snazdr= L (1-cos2). 
0 xm— 0 0 zc 

This limit does not exist. Consequently, the aes integral can not be said to 
exist. 

Ex. 3. Test the existence of the integral ——— 

aS A z . . 

The integrand becomes infinite at = 1. However, the integral exists; for, 

we have 


1-€ dx : K . 
= L f[aresin(1—¢€)-—aresmO]J= UL arcsin (1 —€) =— 
BA! /1 — x eek ( ) 3 0 


If the limit defining either of the two types of infinite integrals 
exists, then the integral is said to converge. Otherwise, the integral 
is divergent. If the infinite integral still converges when the abso- 
lute value of the integrand is taken; that is, if the infinite integral 


Mt) 
| | f(x) |dx converges, we say that the integral converges absolutely. 


By aid of Theorem VII, Art. 24, we may state a necessary and 
sufficient condition for the convergence of an infinite integral as 
follows, since the convergence depends upon the existence of a limit 
which is equivalent to the inequality given in that theorem. 


THEOREM II. Given a function f(x) defined for the interval (a, b) 
and having an infinite discontinuity at the point xo, where a S x S b. 
b 
A necessary and sufficient condition that the integral | f(x)dx converges 
is that we have : 
axe | J@)dz = 
T2— Xo 
where x2 is any value lying between 2 and 2p. 
A similar condition holds for the convergence of an integral having 
an infinite limit of integration. It may be stated as follows: 
THEOREM Ill. A necessary and sufficient condition that the integral 
_ fade converges 7s that the limit Se i f(x)dz exists and is equal 


a zero. 


It should be noticed that this theorem does not involve the con- 
dition that the function f(x) shall approach zero as x increases without 
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limit, as might be inferred from analogy with the convergence of 
infinite series, where it is necessary that the limit L 1 Un(x) shall be 


zero in order that the series  u,(x) shall converge. The infinite 
integral 1G sin z*dzx is an illustration. The integrand sin 2? does not 
0 


approach zero as x increases without limit. However, the integral 
converges; for, putting x? = t, we have 


[sn vax =f" at, 
0 0 Vt 


and the latter integral is known to converge.? 

43. Convergence of integrals with infinite limits of integration. 
Having defined what we shall understand by an infinite integral, we 
shall now consider some of the properties of those integrals which 
arise when cne or both of the limits of integration become infinite. 

In many discussions one is interested primarily in the convergence 
of such an integral rather than in its actual value. It is important, 
therefore, that we become familiar with some of the standard tests for 
convergence. Some of these tests are given in the following theorems. 


THEOREM I. Let F(x) be positive for ell values of x in the interval 
(a, ©), and suppose that the integral “RF (x)dx converges. If for all 
values of x >a we have the relation | f(2) | S F(a), then the integral 

rs f(x)dx converges. 


From the given conditions, we have 


[li@ac| = ["P@d, asa <n (1) 


From the convergence of the ee ae “P (x)dx, we have 


ceed fe F (x) eS = 


Therefore from (1) it follows that 


nina | f(e)de = 0, 


and consequently the integral WE f(x)dx converges. 


1 This fact was first observed by Dirichlet. See Journal fiir die reine und 
angewandte Mathematik, Vol. 17 (1837), p. 60. 
2 Cf. Ex. 3, Art. 43. 
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© gin x 
1+2 
———» we may apply the foregoing theorem. We have, 


Abin 


Ex. 1. Test the convergence of the integral f, 
By putting F(x) = 


La? 
since | sin x | never exceeds the value one, 
© sin x © dz 7 
< == ~ 1, Art. 42). 
te < fy Pom g (Ex 1, Art. 42) 


iva 
From this conclusion it follows that the integral if Toe dx converges. 


This test for convergence of an integral may be called the com- 
parison test and suggests an analogy to the corresponding test for the 
convergence of an infinite series of positive terms. The corresponding 
test for the divergence of an integral may be stated as follows. 


TuroreM II. Let F(x) be positive for all values of x in the interval 
(a, ©) and suppose the integral iL F(x)dx to be divergent. Then, if 


f(z) is always positive or always negative and | f(x) | 2 F(x) for all 
values of x greater than some number Xo > a, it follows that the integral 


f(x) dx is divergent. 


The proof of this theorem is left to the reader to SUP PHY: 


Ex. 2. Test the convergence or divergence of is integral dhe “as, Zo > 0. 
It is possible to find a value x; > 2» such that — = > for zx < az. But for 


xz > 0, the function ei is positive, and we have 
zx xi 
pray A ihe = Pye Pee 
Se ae L feide = L 268 — 4). 


As this limit oe not exist, the integral {i a dz does not converge. Since the 


given function © exceeds efor 2 > x1, it follows from the above theorem that the 
integral fe et 


does not converge. 


TueoreM IIT. If f(x) is bounded and monotonic andif L f(x) = 0, 
if “b(a)dx 


Denote by M the least upper bound of | [ve b(x)dx | as x takes all 


then the integral up f(a) b(a)dx converges, provided 


bounded as x takes all finite values. 


finite values. Since f(x) approaches zero monotonically as x in- 
creases indefinitely, we can choose a value x» such that we have for 
all values of x = 2% € 

f(a) |< 5M 
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By the second Law of the Mean for the integral calculus, we have, for 
Le > 2} = 2X, 


[1@-¢@ae 2 hE m 


S 
fa) f- d@dz|, x 


fea) | fro@ax— ff “teas | 


Hence, we obtain ne ae f(x) b(x)dz = 0, 


€ 
= au 2M =e 


and the given integral converges as the theorem requires. 


Ex. 3. ae the convergence of the integral Sie — an dx, xo > 0! 
Let f(z) =——=- Then 
7 po cee Pee py 
cate} ro W/Z 
We have also 
z nie 
he g(x)dz| = Se sin zdz| = | cosx — cos Xo} S 2. 


Therefore by the above theorem the given integral jn = di converges. 


This example suggests a somewhat similar test for convergence, 
which may be stated as follows. 


TuroreM IV. If a number wp > 1 exists such that x | f(a) | ds 
less than some finite number M for all values of x > xo, then the integral 


f (x)dx converges as x becomes infinite. 
a 


Put zt | f(x) | = p(a). 
We then have 


‘ Se _f{ ¥® 
| fiseerae| = fs) lar =f) SP a 
ae M | 1 
suf S-- Alga 
L M 1 1 
But we have Reegree Ol ga-ga}-0. 


Consequently, we may write 


200 ul fade = 
‘a By 
and the integral Fi f(x)dx converges. 
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Ex. 4. An important function known as the gamma function is defined by 
the relation I'(@) = if  g% 1-2 de. Test its convergence. 


If 0<a< 1, then a—1 is negative, say a—1=-—X. We can select uso 
that 1 < uw = 2) and thus have 


v 
a | f(x) | = o- | xate*| ==, y= 0, 


x — 
which is bounded for all finite values of z. Consequently, f, 1%! e-=dx con- 


verges as x becomes infinite in accordance with the foregoing theorem. 


If a = 1 then the integrand reduces to 2 and the given integral converges 
directly from the definition of convergence. 
If a > 1, we have, upon putting a — 1 =v, where vy > 0, 


(hee e* dz = ee a 7dr, 
iy ee: 


a fo” ads < "5 3 0<k <1, 


and this last integral is convergent as x becomes infinite. Consequently, the given 
integral converges for all positive values of a. 


Since 


THEOREM V. The integral ifs f(x)dx will converge if the integral 


Ra f(x) | dx converges. 
From Theorem VI, Art. 40, we have the condition that 


[tea <a [s@ | dee <a <a 


From Theorem II, Art. 42, and the convergence of the second of these 
integrals, we know Pee 
fo| [ i@)dx 


ne we have 250 sale f(a)dz-= 


Z27 @ 


7) oe oe) 
Z27 ce 


and the given theorem follows. 


Ex. 5. Show that one dx converges. 
By the foregoing theorem ae integral converges if the integral uf = | a dx 
converges. We have : 
fe) x 
fo | AF | aoe 008 oT Stat ie ee er 
w xr ea I> L zoo | 27 


As this integral exists, it follows that the given integral converges. 
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It should be noted that absolute convergence furnishes a sufficient 
but not a necessary condition for the convergence of an infinite 
integral. The following example furnishes an illustration of an inte- 
gral which converges, but not absolutely. 


Ex. 6. Test the integral f,1@ dx for absolute convergence, where f(z) is 
defined as follows, 
{cj forO Sveesels 
=0, forn-1l<a2s n— 


= (— 1)"4, for n-+ <2 Sn, wheren=2,3,4,- ce 


The graph of the function is shown in Fig. 34. The required integral is the sum 
of a series of integrals 


Fig. 34. 


S10) ae = fe) de + f" 7a) de + f" fa) de + + 


=i 0—%-0+3+0—F70-+- © + 
~1-}+}-4+--- 
As we know from elementary mathematics, this series of values converges and 


hence the integral converges. However, if we had taken the absolute value of 
f(z), the resulting integrals would have formed a non-convergent series. 


44, Convergence of integrals of non-bounded functions. We 
b 
shall now consider the convergence of those infinite integrals f f(a)dx 


where f(z) has one or more points of infinite discontinuity in the 
interval (a, b). It must not be assumed that the two types of infinite 
integrals are not related; for, a suitable transformation of the 
variable will change an infinite integral of the one type to the other 
as the following examples show. 
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Ex. 1. Express ff % & as an infinite integral of the second type. 
Put = oS It follows then that 


t 
fe --f{° in-2 dt = Sioa. 


The resulting integral is an infinite integral of the second type if n < 2, otherwise 
it is a finite integral. This example shows also that sometimes it is possible to 
transform an infinite integral into a finite Bs ie ee a suitable transformation. 


into an infinite integral of 


Ex. 2. Transform the infinite integral if I 
the first type. 


1 dt ' 
eyes ee See h 
Put x a Hence, dz G+ 1? and we have 


vee fis ay Ut t+1 eS dt 

oVi= ee cosy: Ve + 2t Af (+1) Vi? + 2t 
It is to be noted that both the given integral and the resulting integral are con- 
vergent. 


The tests for convergence considered in Art. 43 may be restated 
for the class of functions now under consideration. The proofs are 
very similar to those already considered and may be left for the 
reader to supply. These tests are given in the following theorems. 

TueoreM I. Let F(x) be positive for all values of x in the interval 

b 
(a, b) and suppose the integral | F(x)dx converges. If the given func- 


tion f(x) satisfies the condition that | f(x) | S$ F(x) for all values of x in 
_ the deleted neighborhoods of the points of infinite discontinuity of f(x), 
b 


then the integral | f(x)dx also converges. 


Ex. 3. Test the convergence of the integral Se log x dz. 
0G 
The integrand has an infinite discontinuity atx =0. Weknowthat L ztlog x 
0 


is zero. Hence, we may write zt log x <a, where a is any finite number, or what 
is the same thing, we may write 

| log x | < —- 
|x [=] b 
The integral ie erat is convergent. Hence, by the foregoing theorem, the integral 


> log x dz is ae ee 
THEOREM II. Let F(x) be positive for all values of x in the interval 
'b 
(a, b) and suppose that the integral wh F(x)dx ts divergent for x=a. If 


|f(a)| = F(a) for all values of xin the deleted neighborhood of x =a, then 
the integral | f(x)dx is divergent. 
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1 
Ex. 4. Show that the integral f send is divergent. 


0 
Since | sec x| = 1 for all values of x, we have 
= 1 


a=) 


x 


sec x 
0 


and the integral if ; < is known to diverge. Hence, the given integral is divergent. 


b 
TueoreM III. If f(x) is monotone and bounded, then i f(x) b(a)dx 
b a 
as convergent if fi b(x)dx converges. 
Ex. 5. Test the convergence of the integral {.'e~ z log x dz. 


el 
Since the integral Af log x dx converges and in the given interval e-7 is 


bounded and monotone, it follows from the theorem that the given integral must 
also converge. 


It must not be assumed that because the integral of each of two 
functions converges the integral of their product converges. For 


example, if we put 
J@) = O@) =— 
then the two integrals 


HF f(a)de = ip , af ‘O(a)de = 


both converge. However, the integral 


1 
fi1@)-d@ar = [", 
does not converge. 


TuHeoreM IV. [f there exists a number wm, where 0 < wu <1, such 
that for all values of x in the deleted neighborhood of a we have 
(x — a)¥| f(z) | <M, 
where M is any finite number, then the integral }| f(x)dx converges. 
ity a | 
sin 2 
Ex. 6. Test the convergence of the integral ay dz. 
We have for pw = 3 


at] f(2) | =| sin >| ol 
1 ek 
sin ~ 


Consequently, the integral = dz must converge for x = 0. 


THEOREM V. The integral ib f(x)dx is convergent if the integral 


4 f(x) | dx ts convergent. 
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1 
COS — 


al 
: a 
Ex. 7. Consider the convergence of the integral af} 
0 V1 — x? 


According to the foregoing theorem, this integral converges if the integral 


; dx 
sees converges. We have 
0 VJ 1 — 2 


1 1 ‘1 

uf COs — dx i fs l - 
eee =arcsinz | =—- 
oe Vi o/b oun 
1 

cos — 


dz. 


dz 


must converge, and hence 


1 
As this last integral exists, the integral f 
the given integral converges. Vv 


— 27 


45. Properties of infinite integrals. The laws of operation with 
definite integrals were established for bounded functions defined over 
a finite interval. We need to inquire how far they may be extended 
to infinite integrals. It is helpful to keep in mind that, while a finite 
definite integral is the limit of a summation of an increasing number 
of small elements, the infinite integral is the limit of another integral. 
It follows at once, from the definition of an infinite integral, that cer- 
tain laws of operation with finite integrals hold likewise for infinite 
integrals. For example, the integral of a constant times a function 
is that constant times the integral of the function. Likewise the sum 
of two integrals is the integral of the sum of the functions. 

The converse, however, is not necessarily true; that is, in dealing 
with infinite integrals we can not always say that 


J CA@ + fo(x) ] dx = {ladder +f frlo)ae. (1) 


For, it follows from the laws of limits that at least two of the three 
limits defining the integrals involved must exist in order to assert 
that the remaining limit also exists. For example, if it is known that 
the integral on the left converges, then if one of the integrals on the 
right converges the other does also; or if both integrals on the right 
converge, then the integral of the sum converges. However, if 
neither of the integrals on the right converges it is still possible for 
the integral on the left to converge to a definite limit. As a simple 
illustration, consider the two integrals 


us g T 

2x2sin 2 — 1 2 dx 
———— dz, — 

0 x ye 
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Neither of these integrals converges because of the nature of the 
discontinuity at x = 0, but if we take the integral of the sum of the 
integrands, we have 


ae 7 
J[= +5 | a = [sine de = 1. 


A similar remark can be made for the application of the method of 
integration by parts, namely the application of the formula: 


'b b b 
Joudo =u] - fod, (2) 


where one of the limits of integration is infinite or the integrand has 
an infinite discontinuity. We can say, however, that if two of the 
three integrals converge, then the third integral also converges. Thus 
if each of the integrals involved in the second member of (2) con- 
verges, then the integral in the first member converges. 


For example, consider the integral He - sin : dx. The integrand 


has an infinite discontinuity at z = 0. We have 


2 
f ial 1p ~ 1k whe 
— sin - dz = its! rere: 

o ft x 0 Ae Ay 


Put dy =sin= Su =, 


and thus obtain v cos, du = dz. 


Hence from (2) we have 


2 2 
J? Zein} de = -€ 00s! - feos 4 ae. 
é & zx € € x 


The limit of €-cos + as € approaches zero is zero and the integral 
2 
f eos dx exists, since cos ; has but one point of discontinuity and 
0 2 


is bounded. Consequently, the limit ZL f. " cos s dx exists and the 
given integral must converge. ee 4 

We shall now inquire whether the law for the change of variables, 
as stated in Art. 40, holds for infinite integrals. We shall consider 
the case where one of the limits of integration of the transformed 
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integral becomes infinite. The case where the integrand has an 
infinite discontinuity may be stated in a similar manner. We shall 
assume that #(t) is monotone, continuous and has a definite limit as 
t becomes infinite. Let the interval (a,b) for x correspond to (a, ~) 
for t. We have from Theorem XIII of Art. 40 


[seas = [" Loo] DG a 


which holds for arbitrarily small values of € and for all correspond- 
ing values of t’. Upon passing to the limit as € approaches zero and 
therefore as t’ becomes infinite, the limit in the left-hand member 
exists and hence the one in the right-hand member must also exist. 
That is, the law for change of variable applies to infinite integrals 
as for finite integrals. In case the integrand has an infinite discon- 
tinuity the change of variable should be examined for each sub- 
interval within which the integral is bounded and the limit be then 
considered just as was done for the convergence of the integral. 

It follows at once from the definition of an infinite integral that if 


foo} 


f(x) is integrable in (a, 6), or if the integral af f(x)dz exists, then it is 
integrable in any subinterval, and we may write 


J @a = | “ie)ae +f eae, @ < ay <0, 
[Pica =f “Hadax + [feae, Xo > a. 


We have seen that the definition of an infinite integral can be 
extended to the case where the infinite discontinuities form a reducible 
set. It follows from this definition that if f(x) is any integrable func- 
tion having infinite discontinuities, the indefinite integral 


(2) = | ‘ies, Cm taD, 


is a continuous function of z, just as was the case for finite integrals. 
46. Integrals involving a parameter. We shall now consider 


. . . b 
certain problems concerning the integral af f(x, y)dx, where y is to be 
regarded as a parameter. Suppose f(z, y) to be defined for all values 
of x, y in the rectangle R given by the inequalities 


aS¢sbyw<ysd. (1) 
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For the value y = yo, let the given function be defined by the relation 
F(X, yo) = L f(x, y). 
y~vo 
For each value of y ¥ yo we shall assume that f(z, y) is an integrable 


function of x. We shall study the properties of the function defined 
by the integral of the given function, namely 


P(x, y) = | ie, Wak, @ Sv a.0. 


We shall also inquire as to the conditions under which the limiting 
function f(x, yo) may be integrated. 
We have the following theorems. 


TuHeoreM I. Jf f(x, y) 2s an integrable function of x in a given region 
R defined by the inequalities (1) and if f(x, y) is continuous in (a, y) 
together in this region, then 


(a, y) ={ AC gs De eit as ae ay 
is continuous in x and in y within R. 
From the existence of the integral if T(2, y)dx, it follows that the 


indefinite integral ¢(z, y) is continuous in z for each y ¥ yo. To 


Ys 


Fig. 35. 


show that it is also continuous in y at any point (a, 8) within R, 
that is for all values of z and y for which the inequalities (1) hold, 


we have 


(a, 6 + Ay) - o(@, 8) =f 12,8 + Ayde - J "s(x, Bde 
= | "Lsle, B + Ay) — fc, Bye. 
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Since f(x,y) is continuous in (a, y) together in the given region, it 
follows that f(x,y) converges uniformly as y approaches 8, and hence 
we have, for an arbitrary value of e, 


| f(z, B + Ay) - f(a, B) | < «| Ay| < 4, 


[ow 


As € is arbitrarily small and (@ — a) is finite, it follows that € is also 
arbitrarily small and hence that $(z, y) is continuous in y at (@, £). 
But (a, 8) is any point within R. Hence, $(z, y) is continuous in y 
everywhere within this region. 


and obtain 


| d(a, B + Ay) - (a, B)| <e 


= €(@—a) = &. 


Cor. If f(x, y) ts for each value of y an integrable function of x 
within a given region R, then within this region the integral 


J. te, wae = FW 


defines a continuous function F(y), provided f(x, y) is continuous in 
(x, y) together. 


The corollary follows as an immediate consequence of the fore- 
going theorem, and the details of the proof are left to the reader to 


supply. 
TueoreM II. Given a function f(x, y) which is bounded and inte- 


grable as to x in the interval (a,b) for each value of y ¥ yo, and let 
f(x, yo) be bounded and defined by the limit 


f(@, Yo) = ee F(z, y). 


A necessary and sufficient condition that f(x, yo) ts integrable in (a, b) 
is that f(x,y) converges quasi-uniformly in general to f(x, yo) in the 
given interval. 


For each value of y ¥ yo the function f(z, y) is by hypothesis a 
bounded, integrable function of 2 in (a, b). Consequently, for any 
value of y ¥ yo the points of discontinuity of f(z, y) in x form at most 
a set of measure zero. Any point of discontinuity in x for one value 
of y may or may not be a point of discontinuity of f(x, y) for another 
value of y. 

Since f(x, y) converges quasi-uniformly in general, there are cer- 
tain subintervals of (a, 6) in which the convergence is quasi-uniform. 


1 See Arzela, Sulle serie di funsioni, Part 2 (1900), pp. 8-27. 
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For such a subinterval, this condition requires that there exist a set 
of values {yn} dense at yo and on the lines y = y, a finite set of in- 
tervals satisfying certain conditions. Denote by EH, the points on 
y = yn where the function f(x, yn) is discontinuous. The measure of 
£,,is zero, since by hypothesis f(z, yn) is an integrable function of z. 
Consider the sequence of point sets {#,} corresponding to the se- 
quence of values {y,}. Let H be the limiting set of this sequence 
of point sets. Since H, has the measure zero, we have from 
Theorem X, Art. 21, 
L m(E,) = 0 = m(£). 

As E is the limiting set of {H,}, it includes those points where 
f(£, Yo) is discontinuous. The points of discontinuity of f(x, yo) which 
occur in those subintervals of (a, b) where f(x, y) converges quasi- 
uniformly can then be inclosed in a set of intervals the sum of whose 
lengths J; can be made as small as we please. 

To prove the given condition to be sufficient, we assume that 
f(x, y) converges quasi-uniformly in general to the bounded limiting 
function f(x, yo). The sum J, of the lengths of the intervals where 
f(z, y) fails to converge quasi-uniformly is by hypothesis arbitrarily 
small. In the remaining portion of the given interval, namely 


(a, 6) — i + In), 


the limiting function f(x, yo) is continuous; that is, f(x, yo) is con- 
tinuous in (a, 6) except at most for a set of points of measure zero. 
It is also bounded by the conditions of the theorem. Consequently, 
f(x,yo) is integrable in (a, b) and the condition given in the theorem 
is sufficient. 

The given condition is also necessary. For, let us assume that 
f(x,yo) is bounded and integrable in (a, b). The points of (a, b) where 
the oscillation of f(x, yo) is equal to or exceeds an arbitrary num- 


ber 1 form a set of content zero and hence is one which can be in- 


closed in a finite set of intervals the sum of whose lengths can be made 
arbitrarily small. Denote these intervals by 6?, 62,- --, 6%. In the 
complementary set of intervals C'(6°) the oscillation of f(x,yo) is less 
than ” at each point and there is associated with each value of x a 


4 
maximum interval (x — 6, « + 6) for which we have 


| fa +h, yo) — fe, yo) |< Pr [bh <6. (2) 
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However, 5 varies with x and the aggregate of values which 6(z) 
may take has a greatest lower bound Ao greater than zero. For, let 
this lower bound be associated with the point x. But for 2» we have 
an interval [ao — 5(xo), to + 5(xo)], where d(xo) is greater than zero. 
8 (20) (dx) i Par . 
Then, in the interval (%» — —5— 2%o + ae Be is associated with 
Pea 6 es yw (xo) = 
each x within it a 6 which is at least equal to —5—- We can now asso- 


ciate with each point x of C(6°) an interval (@ — Ao, x + Ao) for which 
(2) is valid, provided | 2 | S Ao. It is understood that if x is an end- 
point of one of the intervals C(6°) then only that part of the interval 
(w — Ao, « + Ao) is to be retained which lies within C(6°). 

Likewise, f(x, y.) is integrable for each y, ¥ yo and there exists 
a finite number of intervals 6%, 6@,- +--+, 64, the sum of whose 
lengths is arbitrarily small, containing all values of x where the oscil- 


lation of f(x, y») is equal to or exceeds . For the complementary set 


of intervals, there exists a A, greater than zero such that for each x 
we have : . n 
| fw +t h, Yn) — f(x, Un) | < 4’ | h | < A,. (3) 

Denote by Ao, the smaller of the two values Ay, A,. After 
omitting from (a, b) the intervals 6°, d™, we may associate with each 
x in the remaining intervals an interval (7— Ap,, «+ Aon) for which 
(2) and (38) are both valid. As the selection of y, is arbitrary, there 
may exist values of x in the intervals (w — Aon, «+ Aon) for which 


| f(x, yn) — f(x, yo) | > 2. (4) 


By combining (2), (8), (4), we have 
[fe +h ya) —f(@ +h, yo) | > 2:a—Am << eth<a2tAon (5) 


Consider now any value of x for which (4) is valid. Either the two 
n 


functions f(v, va), f(@, Yo) have each an oscillation less than 4 at 2, 


or at this point at least one of them has an oscillation greater than : 


In the first ease, the point x belongs to one of the intervals 
by, dy, - » » for which (5) is valid, and in the second ease it belongs 
to the set of intervals 6°, 6™ already excluded and need not be further 
considered. Let (ai, 8:) be any interval on y, for which (5) holds. 
Because of the existence of the limit 


L f(x, yn) = f(a, Yo), 


Yayo 
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there exists a value y,,, such that for all values of y, between y,, and 
Yo, we have for the given value of x 


| f(@, yx) — f(@, yo) | < B- 
Combined with (2) and (8), we have 


[f(a th, yn) —f(e@ +h, yo) |<, Ym < Yn < Yo. 


From this relation it follows that as y, approaches yo the length of 
the segment (a1, 6:1) for which (5) holds must approach zero. 

Having chosen a value 7 and a particular y,, we shall now consider 
the aggregate of points x for which (5) is valid and show that the 
number of intervals 6’ is finite and the sum of their lengths is arbi- 
trarily small. Denote by 


(a1, bi), (do, be), 2 rt (ax, bx), Ee a? (dn, bn) 


the closed intervals after the subintervals 6°, 6 have been omitted 
from (a, b). Let x be a point in one of the intervals (az, b,). There 
exists between y, and yo one or more values of y,+, for which 


If(@, yo) - $(@, Yrs) | <3, 6) 
while at the same time the z-oscillation is less than i About each 
z there exists an interval for which (6) holds, which interval lies on 
one side if x is an extreme point of the interval. This interval varies 
in length with y,, and as a function of y,;, has a least upper bound 
L. The value of L varies with x and the values which it may take 
have a greatest lower bound J, greater than zero, since the intervals 
(ax, bz) may be regarded as closed and L is positive. 

Now begin with a. On some line y=Yyn+, there exists an interval 
6,, to the right of a, for every point of which (6) is valid, where the 
length of 6,, 21. Next take the point a/ = a+ 6,, For this point 
there will exist on some line y = Yn+p, a0 interval 64 whose length 
exceeds or at least is equal to / and lying to the right of ay for each 
point of which (6) is valid. Since 1 is greater than zero, we may by 
continuing this process reach the point 6; after a finite number of 
steps. In the same manner, we may cover all of the intervals (ax, bx). 
Hence, the number of corresponding intervals 6’ is also finite, and 
by taking y,+, sufficiently close to yo, each of these intervals may be 
made arbitrarily small, and hence the sum of their lengths also arbi- 
trarily small. As we have seen the sum of the lengths of the intervals 


Avon is also arbitrarily small. 
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Consequently, f(x, yo) can be regarded as the limiting function 
toward which, except for a set of points that can be inclosed in a finite 
set of intervals the sum of whose lengths can be made arbitrarily 
small, f(a, y) converges quasi-uniformly; that is, in (a, 6), f(a, y) con- 
verges quasi-uniformly in general to f(x, yo). 

THEOREM III. Given a function f(x, y), defined for the region 
asxxsb,cSy# yw S d, where we have 


L f(z, y) = f(z, Yo)s (7) 
yo 
and suppose that f(x, y) 1s an integrable function of x for each y A yo and 
that there exists a finite number M such that 
[fay |<M,asrsb,y Ay. (8) 


We then have HE ; f(@, yjde = L A, Z f(a, y)dz, 

Ca y—-Yo a 
af f(x, y) converges to f(x, yo) quasi-uniformly in general in the interval 
(a, 6)." 


The function f(x, yo) is bounded and from Theorem II it follows 
at once that it is integrable in (a, b). Moreover, as a consequence of 
(7) and (8) f(z, y) is bounded when considered as a function of the 
two variables (x, y). And in fact, we may write 

| f(x, yo) —f(z,y)| <2M,asasb,csyd. (9) 
As both f(x, yo) and f(x, y), y ¥ yo, are integrable in z, then 


F(a, y) = f(z, Yo) 77 f(z, Y); 
considered as a function of x, is integrable in any subinterval (a, zx) 
of (a, b). 
Denote by 7, € two independent, arbitrarily small positive num- 
bers. From the conditions given the theorem, it follows that for y 
sufficiently close to yo the points x where 


| f(@, yo) —f@, y) |2n (10) 
can be inclosed in intervals the sum of whose lengths is less than e. 


Let x’ be any one of the values of x for which the inequality (10) 
is valid for a particular valve of y. We shall distinguish two cases. 


First, where F(a, y) has at x’ an oscillation less than 3 and second 


where the oscillation is equal to or greater than As F(a, y) is in- 


1See Arzela, Sulle serie di funziont, Part 2 (1900), § 7. 
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tegrable, its points of discontinuity where the oscillation is equal to 
or greater than - must form a closed set of content zero. Conse- 
quently, we can inclose all such values of z in intervals the sum of 
whose lengths is less than = If, on the other hand, F(z, y) has at 2’ 
an oscillation less than = then there must exist an interval, at each 


point x of which we have 

| F(@, yo) — f(@, y) | > 3 
As already shown in the proof of Theorem II, it follows that the sum 
of the lengths of these intervals has the limit zero as y approaches yo 


and hence can be made less than 5 for all values of y sufficiently close 
to Yo- 

It now follows that there exists a y, such that for all values of y 
lying between y, and y, the points 2’ lie in intervals the sum of whose 
lengths is less than e. Then for all values of x in (a, b) and all values 
of y between y, and yo we have 


[tie w) Fe, Wide <ne-0)+2eM. (a) 


Since 7 and € are both arbitrarily small and (# — a) and M are finite, 
we have in the limit as y approaches yo 


[te yar = Lb fp, wae, 


which is the desired result. 


TuroreM IV. Given a function f(x,y) defined for the region 
asxusb,cSyH yw Sd, where for yo we have 


L f(z, y) oo f(z, Yo), 
yYo 
and where f(x, y) is a bounded, integrable function of x for each y A Yo. 


Suppose that f(x, yo) is bownded and that the limit L f Ta) ax 
exists and defines a continuous function of x. Then ae 


ic pda L [te y)de, asa b, 
e yy 4 


provided the points (x, yo) in the neighborhood of which f(x, y) has no 
finite wpper bound in (a, y) form at most an enumerable set and f(a, y) 
converges quasi-uniformly to the limiting function f(x, Yo). 


1 See Arzela, Sulle series di funziont, Part 2 (1900), §12. 
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As f(a, y) converges quasi-uniformly to the function f(z, Yo), it 
follows that f(z, yo) is an integrable function. From the hypothe- 
sis, there may exist on the line y=yo certain points 2’ such that one 
can not assign an interval (x’ — 6/, 2’+ 6y) and a value y = yn so that 
for all values of x within this interval and all values of y between yn 
and yo we have fz,» |<, 


no matter how large M@ may be chosen. 

The points x’ form a closed set H. If EH is enumerable, then the 
derived set HE’ is also enumerable, since it is a subset of H. In this 
case, HZ has the content zero by Theorem III, Art. 20. 

From the integrability of f(x, yo), it follows that 


o(2, w) = f fle, wae 


is a continuous function. For convenience, put 


Vio, ») = f 1, nar, 
By hypothesis, the function W(x, yo), where 
Vo, yo) =L He,» =L ff, adda, 
y-yo yoy a 


is also continuous. We shall show that 


(x, yo) = W(x, Yo). 

Let x be a point of the set C(Z). We can then assign to z an inter- 
val (wx—6,, x + 62) and a value y = y, such that for any value of x in 
this interval and any y between y, and yo, we have 

lf, y) |< M, 
where VW is a finite number. For these values of z, let us consider 
the difference ratios 
o(x + Az, Yo) —(a, Yo) (a ae Az, yo —W(a, Yo) 
Ax ; Ax | 


where x + Az is so chosen as to lie in the interval (x — 6, x + 6:). Let 
\ be an arbitrarily small positive number. Since for each a in C(E) 


have 
we nave (a, Yo) = L (a, y) ) 
y—yo 


we can so choose a yn that for each y between y, and yo we have 
W(x + Ax, to) — W(x, 19) Wa + Ax. 1) — W(x, y) 


x Az 


+ A, 
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vhere —-1 <u <1. From the definition of (a, y), we have 
Wia+Az, y)—V(a,y)_ 1 (t* 
ee 


where x and z+ Az lie in the interval (x—6,, x+62). From Theorem 


; It Ax *rtAx 
III, the integral J f(x, y)dx differs from | f(x, yo)dx by less 
than ) for each y sufficiently close to yo. Hence, we have 
1 fee F 1 (rte J aN 
Ke it F(@, yo)da + Ma 


where —1 < p’ < 1, and J is independent of x and Az. From the 
foregoing relations, we have 


W(x + Az, yo) — V(x, Yo) oe fies se 
Ax Aue f(x, yoda + UA + be ne 


p(x + Ax, yo) — H(@, Yo) pe 
Nar 
As this relation is valid for every pair of values x, x + Ar chosen in 
the manner indicated, it follows that for each point x of C(Z), we 
have in the limit as \ approaches zero 
W(x + Ax, yo) — W(x, yo) _ $@ +At, yo) — OP Yo) | 
Az Ax 


As Az approaches zero, these ratios give us two corresponding deriva- 


tive numbers of W(c, yo), $(2, yo), say D+ W(x, Yo), D* $C, Yo). 
By hypothesis, Z is an enumerable set; hence, it follows (Art. 31) 


that for all values of z in (a, b) we have 
W(x, yo) = (2, Yo) +6, 
where cis a constant. However, c = 0, since for x = a, we have 
W(a, yo) = (4, Yo) = 9. 
Consequently, we have for all values of x in (a, 6) 


(a, Yo) = o(a, Yo)3 
that is, TE “f(x, yo)de = L Ae f(e, y)dx,a Sab, 
a yr yo a 


which establishes the theorem. 
As uniform convergence is a special case of quasi-uniform con- 
vergence, we haye also as a corollary to the foregoing theorem the 


following: 
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Cor. Let f(a, y) be a bounded, integrable function of x fora Sx Sb, 
cy ~ yo Sd, where 
L f, y) = f(a, Yo), 
yyo 


and f(x, yo) is bounded. Then, af f(x, y) converges uncformly to f(x, Yo) 


and uf L if f(a, y)dx defines a continuous function, we have 
yy Y 


[feud = bf se, vae. 


If we replace the parameter y by the subscript n, we may apply 
the foregoing theorems to the integration of a sequence of functions 
{f,(x)}. Let us suppose that for each value of n the function f,(2) is 
bounded and integrable in the interval (a, b), and let {f,(2) } con- 
verge to the bounded function f(z). It then follows from Theorem 
II that the necessary and sufficient condition that f(x) be integrable 
is that the given sequence {f,(x)} shall converge quasi-uniformly in 
general in the interval (a, 6). If in addition to quasi-uniform con- 
vergence in general we have the condition that for all values of n 


and of x in (a, b) Payee 


where M is some finite number, or if the convergence of jfn(x)} is 
uniform to a bounded function, it then follows from Theorem III 


that 3 2 
ff Sade = LE i Sale Oced saveseyt (12) 


If, on the other hand, we have the condition that f,(x) is integrable 


and bounded for each value of 7 and the limit L af “fn(a) dee exists 


nC 


and is a continuous function, but that as n increases indefinitely 
f,() exceeds all finite bounds in the neighborhood of certain points 
of (a, b), then we have from Theorem IV the relation expressed in 
(12), provided these points form an enumerable set EH, and {f,(zx)} 
converges quasi-uniformly. From the foregoing corollary, it follows 
that it is sufficient if the convergence is uniform. 

In Theorem I, we considered the continuity of F(y), where 


FQ) = fsa, wae 


and a,b are constants. We shall now consider the case where a 
and b are replaced by functions of y, say di(y) and ¢2(y), respectively. 
We may state the following theorem, 
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THEoREM V. Let F(y) be defined by the relation 


2 (y) 
F(y) alae {@ yt, osreb cseyed, 


where di(y), P2(y) are continuous and f(x, y) is continuous in (2, y) 
together. Then F(y) ts also continuous. 


From the conditions of the theorem we may write 


F(y + Ay) — Fly) 


ipods And py) 
a die Ay) f(z, Yy a y) da ei) f@, y)da 


Jo 'Ci@e y+ by) -F@,y) ae 


oa $i(y) 


He ea p2(ytAy) is 
a Gaius f@, OPS y) Lv + ox) f@, Ose y)dx 
poly) 
= fC se, y + Ay) - S00, de 
slics ( A Ja px(ytAy) he 
ze ecrnee Bd Be UE SE 2(y) PCN aU) ae. 


Taking absolute values, we have 
poly) 
\Fy + dy) — POs | ["LI@, 9 + Ay) - Fe, a) lez 


tho rf A a wks: ( ay 
x xe x x 
os | dr(ytAy)* * ’ fe Sa dy) F(z, y + Ay) 


Because of the continuity of f(x, y), we may put 
| f(a, Yy 7 Ay) — f(z, y) | << €, 


whence the second member of (13) may be written, if we make use of 
Theorem X, Art. 40, 
1(Y) 


poly) 'p 
[Fy + dy) — FW <e fo” del +1 seo y+ ADI fe Lae 


p2(yt+Ay) 


Ee | f(a, Via Ay) | det) | dx Gj 


where 2 is some value between ¢i(y) and gi(y + Ay) and 2% lies 

between ¢2(y) and ¢2(y + Ay). This inequality gives upon inte- 

gration 

| F(y + Ay) — Fy) | < €| bay) — dily) | + | fo, y + Ay) | Ag | 
+ | f(a, y + Ay) | Ade]. 


a 2G) 
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By taking Ay sufficiently small we can make e€, Adi, Ag: arbitrarily 
small and hence obtain the relation 
| Fy + Ay) — Fy) |< 4. 
It follows that F(y) is continuous, as the theorem states. 
Ex. Discuss the continuity of F(y) defined by the integral 
yr dx 
f ——;’ y >0- 


Here both limits of integration are continuous functions of y, and the integrand 
is continuous in « and y together. Hence, the conditions of the theorem are 
satisfied and the integral defines a continuous function of y. 


THEOREM VI. Given the function F(y) defined by the relation 
b 
F(y) -f f(@, y)dz, 43% 5b,csysd: 
The derivative of F(y) 1s gwen by the relation 
dF ("0 of 4 
dy ~ Ja dy a 
provided the function f(x, y) is continuous in (x, y) and has a partial 
derivative which is also continuous in (a, y). 
We have for any value yo of y 


F(yo + Ay) — F(yo ; 
Pye By) — Ph) _ = fC 1Ce, yo + Au) ~ Se, ys) de 


: f(z, Y st Ay) oe (x, 
-{ [Sete to I we = SK, Yo) ae (44) 
However, by the Law of the Mean, we have 


f(x, yo + Ay) — f(x, yo) 


Ly =fy@, §), y SES y+ Ay, 


oy fy @, Yo) + n(Ay}, 


where 7 may be chosen independently of x, because of the continuity 
of f, (x, y) in (x, y). Moreover, we have 


L (Ay) = 
Ay—0 
From (14) it follows that 


F(y+A F (yo) 
ve in ue Sey = {fi (x, yo)dx + fondx 


= [la wae +1 - 4), 
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whence upon passing to the limit we obtain the desired result 


dF > 
sf K@ wae 


for any value yo of the variable y. 
In case the limits of integration are functions of the parameter y, 
we have the following theorem. 


TuHrorEM VIII. Let f(x, y) be such a function that a exists and 


suppose f(x, y) and = to be continuous in x and y together, where 
SQacab,cays a Then vay oe exist and we put 
FYy) = ic y)dx, 
. oily) 
we may write 
dF gy) g d d 
2 ae — Hos, Woe + 10s, Woe 


dy Jew) 


We have at once 


Fy + Ay) — FY) _ 1 | if ey ee 


Ay Ay LJ gistAy) 
‘b2(y) 
- J... fear]. 5) 
gily) 


However, the first of these integrals may be written 


o2(ytAy) p2(y) 
foe eeu + Audde =f 1, v + Avdae 


i(y+Ay) 
se A a ie y+ ” 4 BeA )d 
he ay es 
a POA hala bas aad Fa »y + Ay 
Substituting in (15), we obtain after combining terms 


Fy + Ay) — FQ) _ (* fay + dv) - fe) gy 


Ay gy) Ay 
+ ho hie y+Ay)dz gles fA; y+Ay)dx 
di(y-+Ay) Ay o2(v) Ay 


poy) f(to, y + Ay) (% 
- [i deli + ORy) dit: Ay duly+Ay) 
f(a, y + Ay) yeas 
Ay $2(v) 


where 0 < 6 <1, and 2, x are points between ¢i(y), dily + Ay) 
and d2(y), d2(y + Ay), respectively, as required by the Law of the 


v; 
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Mean for differentiation and for integration. Evaluating the last 
two integrals, we have 


F(y + Ay) — F(y) ey) 
Ay iy Ie fila, y + OAy)dz 
bly + Ay) ~ dal) 


— f(to, y + Ay ay 
+ f(a, y + Ay) ae 


Upon passing to the limit as Ay approaches zero, remembering that 
fi(a, y) is continuous in (a, y) and that x and x become qi, $2, 
respectively, we have the required result, namely 


dF .. p2(y) Ol as fe Fi 
dy — ily) ETc — Ihr, Wa + f(dz, Y) 9 


47. Uniform convergence of an ae integral. ” shall first 


a 


consider infinite integrals of the type if f(x, y)dx, where y is to be 


regarded as an arbitrary parameter lying between two constant val- 
ues, cand d. We shall assume that for each value of y the integral 
converges. It then follows that for each value of y, say y = 41, 
there exists a corresponding value of x, say = 2, such that we have 


Je ie wae 


where 2, is the greatest lower bound of those values of x for which this 
inequality holds, and € is an arbitrarily small positivenumber. As y 
varies, the corresponding 
value of the lower limit 
of integration may also 
change in order that the 
inequality (1) may hold 
for the same value of e. 
As y takes all values in 
the interval (c, d), € re- 
maining unchanged, the 


<6, (1) 


7 aggregate of the least 
Y values of x which can be 
Tra. 36, selected as the lower limit 


of integration may have a 
finite upper bound, which we shall denote by x. Then for a given e 
this value x = % is independent of the choice of y and may be said 
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to answer uniformly well for all values of y. We say then that the 
given integral converges uniformly in the interval (c, d). 

Even if the given infinite integral does not converge uniformly, it 
is possible that for a given value of «> a, say 2, there exists beyond 
x, a finite number of lines 


4b Shy Sy Ch FO a, 


such that for all values of y in the interval (c, d) and for a lower limit 
of integration taken on 
the broken line x, we have 


J te wax 


where it is to be under- 
stood that the segments 
of this broken line project 
upon the line «=a in 
such a manner that these 
projections exactly fill the ey. 

interval (c, d). If these 

conditions are satisfied for every choice of 2; however large, then 
we say that the given infinite integral converges quasi-uniformly in 
the interval (c, d). Of course any infinite integral which converges 
uniformly also converges quasi-uniformly, but the converse is not 
true. 

If the given integral converges quasi-uniformly in the given inter- 
val with the exception of a finite set of subintervals the sum of whose 
lengths can be made arbitrarily small, then we say that it converges 
quasi-uniformly in general in that interval. 

In Art. 26 we considered certain tests for the uniform convergence 
of a function of two independent variables which are similar to those 
that may be stated for infinite integrals. Some of these tests are 
given in the following theorems. 


Z 


SiS 


TuroreM I. For all values of y in the interval (c,d), let f(x, y) 
satisfy the condition f(z, y) | <M(x), 
where M(x) is a finite, positive function of x alone. Then if the integral 
M(zx)dx converges, the given integral f(x, ydx converges abso- 


lutely and uniformly in the interval (c, d). 


266 RIEMANN THEORY OF INTEGRATION [Cuar. V 


Since M(x) is independent of y and the integral aa M(x)dx con- 


verges, we can replace the lower limit of integration a by a value 2, 
which does not depend upon y, such that we have 


if “M (x) dx 


We therefore have the relation 


[1 y)dx s | 10, y) | dx < [ M@az < [ M@ae Paes 


Hence, it follows that the given integral converges uniformly. That 
it also converges absolutely follows from the definition of absolute 
convergence. 


< €é. 


Ex. 1. Test the infinite integral if, " = = dx for uniform convergence. 
0 SL 
sin (xy) es 
We have eee: <Ty mp = MO. 


x xz dz 
it M (x)dx = i rer) = arctan z. 
. . . oo) 
The infinite integral ae M(x)dx converges; for, we have 
0 


foo} o Wd. 
f M(a)de = f aan oe arctan x = 4. 


The given function therefore satisfies the conditions of the foregoing theorem 
and hence converges both absolutely and uniformly in any finite interval for y, 


TueroreM II. If the integral cf f(x, y)-b(a)dx converges for each 
value of y in the interval (c, d), it then converges uniformly in this 


interval, provided the integral | (x)dx converges absolutely and f(z, y) 
is bounded in (x, y) together. 


We have lf, y) | & .M, 


where M isaconstant. We may also write, since J. (x)dx converges 
absolutely, ‘ 


Ji e@) de <6 m <n <a 


We thus obtain a value of x» independent of y such that for x» <21§<22 
we have 


Jo 1@9-e@ar|sm| ["o@arlem ["\6@ lar <e. 


Consequently, the given integral converges uniformly in the interval 
(c, d). 


<M 
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ae CL 
sin— 
Ex. 2. Consider the uniform convergence of ue —— dx for values of 
roo ' x(x + y) 
We may let $(x) == sin = and f(z, y) = @ey It follows that JS. o@dz 


converges snechiely anes kas have 
Pee | 
oo} Sin — co 1 
ap dx < if =i 
1 ice 
and the latter integral converges by Theorem III of Art. 43. Moreover, the 


function 1 
f(z, y) = @+yP 


is bounded for all values of x and y, where x > 1, y > 1. It then follows from 
the foregoing theorem that the given function converges uniformly for all finite 
values of y > 1. 


eed 
sin —dz, 
& 


x 


We may now state the following theorem. 


TueoreM III. If f(z, y) is continuous in (x,y), yoSy Sd, x= n, 
a necessary and sufficient condition that the integral | f(x, y)dx defines 
TZ 


a continuous function of y is that this integral converges quasi-uniformly 
wn the interval (yo, d). 


Put F(a, y) = | ie, Wade, Yo a @ Ot = 2: 
Since f(z, y) is a continuous function in (2, y) together, it follows 
from Theorem I of Art. 46 that is f(z, y)dx defines a continuous 
function of y. It is also continuous in 2, since f(x, y) is integrable 
for every value of y and for all finite values of the upper limit of in- 


tegration. We also have the condition that the limit ee PG, y) 
exists for each value of y; that is, we may write 


L F(a, yx) = {0 Ae), 4p a nat. 


By hypothesis F(z, y) converges quasi-uniformly. Consequently, 
this function satisfies the conditions of Theorem XI of Art. 26, where 
the limiting value of the function is taken as one of the variables 
becomes infinite. It then follows that a necessary and sufficient 


condition that © 
P(o,y) = ffl, ae 


shall be continuous in y is that given by the theorem. 
As uniform convergence is a special case of quasi-uniform con- 
vergence, the following corollary follows at once from the foregoing 


theorem. 
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Cor. If f(x,y) is a continuous function of (x,y) in the region 
Yosxysd,x=m%, then the integral Jp f(a, y)dx defines a continuous 
zl 


function of y if this iniegral converges uniformly. 


If the limiting function F(~, y) is continuous, it is of course inte- 
grable. The above theorem, as also the corollary, gives a sufficient 
condition for integrability. A necessary and sufficient condition 
follows as in Theorem II of Art. 46 when we recall that the limit 
is now taken as x becomes infinite instead of y approaching a finite 
limit yo. This condition can be stated as follows. 


TuroreM IV. If f(x,y) is continuous in (a, y) in the region 
yosy sd, x=X, a necessary and sufficient condition that F(y) defined 


by the integral AP Ge, Dae is integrable in the given interval (yo, d) is 


that the given integral “Tf (x, y)dx converges quasi-uniformly in general 
um (Yo, d). i 


The discussions in this article have thus far concerned the type 
of infinite integrals where one or both of the limits of integration be- 
comes infinite. Similar statements can be easily shown to hold for 
those infinite integrals where the integrand becomes infinite in the 
interval of integration. 

48. Double integrals. Repeated integrals. Let f(z,y) be a 
bounded function of the two independent variables x and y in the 
region F&, defined by the inequalities 


@ Sts 0 cis Yen. 


Denote by A;(z, y) the rectangle formed by the increments A,2, 
Av of and y. Let f(&, 7.) be the value of f(z, y) at any point in 
A,(x, y). As in the functions of a single variable, we form the sum 


= S (Ee, ne) An (a, y) 


taken over the region R. Let A(z, y) be the norm of the values 
Ax(a, y). If the limit 


ib 2 Sey mA, ») (1) 


exists as the norm A(z, y) approaches zero and simultaneously the 
number n of rectangles increases indefinitely, we call this limiting 
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value the double integral of f(x, y) taken over the region R. Sym- 
bolically, we shall represent the double integral by 


[fev a, ». 


If we replace A;(x, y) by the product A,«-A,y, we are led to 
an iterated integral, which we may denote by 


f a f a y)dy. 


If the order of integration is reversed, we have the iterated integral 


Joa f te, y)dx. 


An iterated integral is only successive integration of f(x, y); first with 
respect to the one variable and then with respect to the other. 

In a similar manner, we may define an integral of higher order 
than the second. We shall, however, limit our discussions to those 
given. 

Just as for the integrals already discussed, so for double integrals 
we can define an upper and a lower integral. For example, let f(z, y) 
be defined for the region R, and suppose we form the sum 


2 F(Ex, ne) Ax(2x, Y); 
where for each k the value f(&,, nz) is the least upper bound of f(a, y) 
in the rectangle A,(z, y). If the limit of this sum exists as n becomes 
infinite in such a manner that the norm A(z, y) approaches zero, we 
call this limit the upper double integral and denote it by the symbol 


J, fond». 


In a similar manner, we may define the lower double integral 


ihe f(a, y) d(x, y). 


A necessary and sufficient condition for the existence in R of the 
double integral is that the upper and the lower integrals have the 
same value. If the given function is bounded, it is also necessary 
and sufficient that the two-dimensional set of points where f(z, y) 
has an (2, y)-discontinuity has the measure zero. The proofs of 
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these statements are similar to those for the corresponding theorems 
for integrals of functions of a single variable and need not be re- 


peated here. 
The double integral has been defined for the continuous domain R. 


One can, of course, generalize this definition by replacing the given 

region R by a bounded set of points # located in the plane and speak 

of the integral of f(x, y) with respect to this two-dimensional set. 
Turorem. If f(x, y) is bounded with respect to the two variables to- 


gether, and the double integral e f(x, y) d(x, y) exists, where R 1s defined 


by the inequalitres 
hea a Olea Cea, (1) 


then each of the zterated integrals 


fa if I (x, y) dy, df ; dy HL F(@, y)dx 


exists and is equal to the double integral. 


We shall first show that 


fra fre, y) dy s {fe y) d(x, y), 


he de fj (x, y) dy = {. f(a, y) d(a, y). 


Let the given region & be divided into smaller rectangles Ax(x, y) by 
drawing lines parallel to the sides of R. From the definition of an 
upper integral, we have for an arbitrarily small positive number € 
and a properly chosen value of A,(z, y) 


JpI@p ev) ez DFE, mAde, v, 


where f(&:, nx) is the least upper bound of f(z, y) in A;x(z, y). Denote 
by A. the length of the interval on a line parallel to the Y-axis and 
lying in the rectangle A;(z, y). If this line is a boundary of one or 
more of the rectangles A(z, y), always take the point (£, 7) in the 
rectangles lying on the same side of the line. We then have 


[1 y) dy SZ’ f(&., mo) Axn, 


where 2’ denotes the summation taken over those rectangles A;(z, /) 
which are cut by the line along which the integral is taken. Forming 
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in a similar manner the upper integral of this result with respect to 
x, we have 


Ti 7a = vin 
Jia fi Se.u) dy = B HE, m) Me s fle, v)d 9) +e 
As this relation holds for all values of e, it follows that 


fra fF, y) dy sf fe, y) d(x, y). 


By a similar argument, we can show that 


b d 
I dx J, f(x, y) dy = ft, y) d(x, y). 
By hypothesis, the double integral exists, and hence we have 


Jie nae,» = [sev de»). 
It follows that 


[ise y) d(x, y) 2 Jraz ff, y) dy 2 [raz f se, y)dy 
= [iit y) d(x, y). 


As the two extreme integrals are equal, it follows that we have 


fea ['s (z, y) dy = (if ae ip f (x, y) dy ~ fae fH, y) dy 
| - frac fs (xy) dy. 


b a 
Consequently, the iterated integral f dx | f(x, y) dy exists and is 
equal to the double integral. ek 
Likewise, it may be shown that the iterated integral 


df a i I, y)dx 


exists and is equal to the double integral. The theorem is thus 
established. 

In the statement of the foregoing theorem, we regarded the 
region R as a rectangle defined by the inequalities (1). If Ris not a 
rectangle, the theorem still holds as we can then circumscribe the 
given region by a rectangle and define the given function f(a, y) as 
zero at all points exterior to the given region. We then integrate over 
the rectangle as before. 
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As we shall see later, the foregoing theorem gives a sufficient 
although not a necessary condition; that is, there are functions 
f(x, y) for which the two iterated integrals exist and are equal but 
the double integral does not exist. 

The existence of one of the iterated integrals does not imply the 
existence of the other nor of the double integral. For example, con- 
sider the function f(z, y) defined as follows: 

Let f(a, y) = 3 for all rational values of y, and suppose f(z, y) = x 
for all irrational values of y. Then for rational values of y we have 


fied = fo 5d = 5 


For irrational values of y, we have 


1 i a2 1 1 
Hence, we have 


Sale Oe eee ere 
fief te nae = [05a = 3) = 5 


However, in the region 0 S751,08 ti 1, f(x, y) is a totally 
discontinuous function of y, except as x = 4, since it has the value 
+ for all rational values of y and a value different from 3 for all irra- 
tional values. As the measure of the set of these points of discon- 


af 
tinuity is not zero, it follows that the integral i f(a, y) dy, 2 4, 
0 


can not exist. As these points of discontinuity are also (x, y)-dis- 
continuities, it follows also that the double integral does not exist 
in the given region. 

As already stated, the two iterated integrals may exist and be 
equal and at the same time the double integral taken over the region 
not exist. One might infer that this would be possible since the 
iterated integrals depend upon the existence and inequality of two 
sequential limits, while the double integral depends upon a double 
simultaneous limit. As we know, the former may exist and be equal 
without implying the existence of the latter limit. That this inference 
is correct is shown by the following illustration. 

Consider the region R defined by the inequalities 


enh (ys A 


Cf. Thomae, Zeitschrift fiir Math., Vol. 23 (1878), p. 67. See also Pringsheim 
Ber. der Miinchen Ak., Vol. 29 (1899), pp. 39-62. 
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Draw the diagonal OQ, Fig. 38. For each point P on this diagonal 
the two codrdinates are equal. We shall consider only those points 
P of the region R for 
which both x and y have 
rational values. For ex- 
ample, let x) be any rational 


number 0 S$ P <1. Divide 


the segment Ox) into gq 
equal parts and through 
the points 

2 p 


0, qd q ee are (1) ' Fie. 38. 


draw lines parallel to the Y-axis. Through the corresponding points 
on the Y-axis draw lines parallel to the X-axis intersecting the first 
system of lines. On each of these lines there are p such intersec- 


tions. Let E denote the set of all such intersections as : takes all 
rational values between 0 and 1. It is to be noted, however, that the 
points contributed to EH by any choice of ; all le to the left of the 
line 2 = : and below the line y = i It is to be understood that by 
any subsequent choice of : none of the intersections of the additional 


lines drawn parallel to the two axes with those previously drawn 
shall be points of F#. 

The set E has the property that only a finite number of points of 
E lie on any line in R parallel to either axis. The set H is everywhere 
dense in R; for, it is always possible to select ¢ so that at least one 
point of # will fall within any subregion of & however small that 
subregion may be. 

We will now define f(z, y) to be zero for all values of # and equal 
to one for all points of the complementary set C(Z). The function 
f(x, y) is then bounded with respect to the two variables and on any 
line parallel to either axis it has a finite number of points of discon- 
tinuity with respect to & OF to y, and at each of these points the saltus 


is one. The integral if f(x, y)dz therefore exists and is equal to one. 
0 


Hence, we have upon integrating with respect to y 


fran {se y)dxz = 1. 
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In a similar manner, it may be shown that 


fae fi se, way = 


The double integral yf f(a, y) d(z, y) can not exist; for, the set H is 
everywhere dense and at each point the (x, y)-saltus is one, and the 
function f(z, y) is totally discontinuous in the two variables taken 
together. 

It should not be inferred that because the double integral 

'b 

{E f(x, y) d(x, y) exists the integral f f(z, y) dx exists for all values 
of y. For, as we know, a double limit may exist without the single 
limits in the corresponding iterated limit existing for all values of 
the variables in the neighborhood of the critical point. However, 


the integral ; 
FW) = fi, nae 


may not exist for certain values of y and yet both the double integral 
‘d b 
dh f(x, y) d(x, y) and the iterated integral ih dy aff f(x, y) dw may 


exist, provided the values of y for which F'(y) fails to have a definite 
value form at most a set of measure zero. If itis assumed that f(a, y) 
is bounded in (a, y), it follows that F(y) is continuous for those values 
of y for which f(z, y) is continuous in (a, y). From the foregoing 
theorem, it follows that if the double integral exists, then we have 
under the above conditions 


f,sew ae, v) = fay [se v) ae. 


EXERCISES 

1. Consider the point set discussed in Art. 17 by dropping from the given 
interval the middle 3, etc. The set # is defined as the end-points of the intervals 
dropped together with the limiting points of those end-points. For each point of 
E, let f(x) be one, otherwise zero. Show that f(x) is bounded, has points of dis- 
continuity at a set of points having the cardinal number of the continuum and 
yet the integral if f(x) dz exists. 

2. Given f (x) = ae L (cos klx)?". Does the integral fp f (x)dz exist? 
Give dei et i your  OORelutiN: 

3. Find &, where z = He log (2? + y*)dy. 


OZ Using L7/ 
4, Find —> wh = —z Dt 
in ay where z f° . dz. 
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5. Evaluate the following integrals or show that they do not converge. 


© omdx © log x dx 
(2) i} ei ee (0) 1 Uae 

Tv 

2 dz cos x 
c) {? d —~ de. 
( ge @ f Vax i 


6. Given f(x) = ¢i(x) — b2(x), where 
Gi(x) = e*, do(z) =a" + aar714.-.. Sh Gy. 


Show that f(x) is a function of limited variation. What consequences follow 
from this conclusion? 

7. Given a function f (x) such that D+f (x) <9. What properties of f(x) 
can you state? 

8. Can a function of limited variation have an infinite number of oscillations 
in the neighborhood of a point? Could such a function be absolutely continuous? 
Could it be uniformly continuous? Could it be integrated? Must it be bounded? 
Give reasons for each conclusion. 

9. Could a bounded, integrable function have points of discontinuity at a 
set of points of the first species? first category? at a set having the cardinal num- 
ber of the continuum? Could such a function belong to Baire’s first class? second 
class? 

10. Could a function of limited variation be discontinuous at the rational 
points? at the irrational points? Illustrate your conclusions. 

11. Test the following integrals for convergence. 


OO) 1 co 1 
(a) (ee) a, 0) J, y dy, 
Of pBe ae, @) { a. 


1 
12. Show that cos {sin} is an integrable function in the interval 
a 


et 
—-1s2<1. Is the function ¢(z) = {sin 4 also integrable in the same 
interval? 
13. Find the derivative with respect to y of the following functions. 


gily) = (> oe 


y loga 


1 
dz, de(y) -f xz” log” «dz. 


14. Given the function f (z) = sin ‘, x £0, and let f (x) =Ofor2=0. This 
function has an infinite number of oscillations in the neighborhood of the origin. 
Is it integrable in the interval (— 1, 1)? Would a function be integrable if ace 
the same kind of oscillations in the neighborhood of the points of the set 2 ? 


at the rational points? at the irrational points? at the points corresponding to 
the algebraic numbers? , 

15. Without integrating, show that f (y) = f, ylogzdx is a continuous 
function. 
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16. Given f(z) = L (cos 2 )"for x ~ 0, and let f(0) = 0. Does the integral 
fe f(a) dx exist? ae 

17. Given f(z) defined by the sequence { f,(x)}, where fr(x) = =e Does 
the integral f f(x) dz exist? Does the given sequence converge uniformly? 


quasi-uniformly? Is f(x) continuous? 
18. The given function f(x) is defined by the sequence {f,(x)}, where 


ISn(a) = 2n?x e” *2” Discuss the existence of the integral [ f(x)dz. Can we write 
L cS fa(x)de = ie f(x) dx? 
“19. Test the following integrals for convergence. 


1 
(a) Por sin : dz, (b) f log x sin t dz. 


20. Show that every bounded, monotone function can have at most an enum- 
erable set of points of discontinuity. 


CHAPTER VI 
LEBESGUE AND OTHER INTEGRALS 


49. Measurable functions. As we have seen, the Riemann 
integral depends for its definition and properties upon dividing the 
interval or region of integration into a finite number of subdivisions. 
We shall now consider a more general type of integral based upon the 
Lebesgue measure of the set of points over which the integral is to 
be taken. As preliminary to that discussion, we shall introduce what 
is called a measurable function. For this purpose, let us suppose 
that we have given a set of points H on the X-axis, for which f(z) is 
single-valued and either finite or infinite with a definite sign. Then 
f(x) is called a measurable function on the set # if H itself is measur- 
able and furthermore if the points of EH for which f(x) 2 A form a 
measurable set, whatever value is given to A. This definition of a 
measurable function can be extended to a set of points in a space of 
any number of dimensions. Likewise the theorems concerning meas- 
urability may be extended to space of two or more dimensions. 

For convenience, we shall denote by 

EL f(z) < A], ELf@) > A] 

the subset of # for which f(z) is less than and greater than A, re- 
spectively. As an illustration of a measurable function, let f(x) be 
defined for a set EH and bounded for the points of this set. The func- 
tion f(x) is measurable on £ if the subset ELA S f(x) < B] is meas- 
urable for all values which may be assigned A and B. As will be 
seen, there is no restriction on f(x) as to continuity and no restriction 
on the set H other than that it must be a measurable set. Among 
the properties of measurable functions, we have those given by the 
following theorems. 


Turorem I. The function f(x) is measurable on the measurable set 

E if any one of the four sets 
ECf(z) 2 Al, ELf(x) < Al, ELf@) > Al, Hf@ 2A) 
is measurable for every value A; moreover, all four sets are then meas- 


urable. 
Zid 
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Let us assume that the set E[ f(x) = A]is measurable for any value 
of A. It follows that E[ f(x) < A]is measurable since it is the 
difference between the measurable set H and the measurable set 
E{ f(x) 2 A]. Fora similar reason, if either of the last two sets is 
measurable, the other is also. 

It remains to show that one of the last two sets is measurable. 
From the given hypothesis it follows that each of the sets 


Bf) 2A +i) n=1,2,- sets 


is measurable. Since the set #, is measurable and lies in a finite 
interval, it follows from Theorem V, Art. 21, that the sum of the 
sequence of sets {H#,} is also measurable. However, the sum of the 
sequence {Z,} is none other than the set EL f(x) > A], and hence 
this set is measurable. With this result the proof is complete. 

We have the following corollary of the foregoing theorem. 


Cor. 1. The function f(x) is measurable on the set E uf one of the 
sets (1), say EL f(x) 2 A], 7s measurable for all rational values of A. 


Any real value of A, rational or irrational, can be represented as 
the limit of a sequence of decreasing rational numbers A,, Ag,: - 
An,* * +. The sequence of sets {H,}, where 


EALf(x) 2 Ax Wi lp 2, 3°: ) 


satisfies the conditions of Theorem VIII of Art. 21 and consequently 
the sum of this sequence is measurable, the measure being the limit 
of the measures of the above sequence of measurable sets. However, 
the limit of this sequence is the set E| f(x) > A], and this is one of 
the sets given in (1). Hence, it follows from the foregoing theorem 
that f(x) is measurable on the set H, as the corollary states. 


. 
’ 


THeEorEM II. Jf f(x) 2s measurable on each of a finite or enwmerably 
infinite set of distinct point sets { E,} contained in a finite interval, then 
f(x) ts measurable on the sum E of these sets. 

Wehave E=F,+h,+-°- - +84 - 


By Theorem V, Art. 21, the set His measurable. Since f(x) is meas- 
urable on each £,, it follows that for any A, the subset Z,[ f(x) > A] 
is measurable. Then by Theorem VI, Art. 21, we have 


mE( f(z) > A] =mE[f(z) > A]+mE[f(z) > A]+-- - 


: ; +mE,[f(t) > AJ+:-°°3 
that is, f(z) is measurable on the set E. 
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THEOREM III. Jf f(x) zs measurable in a domain D containing 
the measurable set E, then f(x) is measurable on E. 


By hypothesis the points of the domain D where f(z) = A form a 
measurable set DL f(x) 2 A]. Since £ is also measurable, the product 


{£: DL f(x) 2 Al} 
must be measurable. But this product is nothing else than the set 
El f(z) 2 A], and hence f(x) is measurable on E as the theorem 
requires. . 
We have also the following theorem. 


THEOREM IV. [If f(x) is measurable on the set E, then it is measur- 
able in any finite domain, provided that in this domatn it takes the value 
zero in C(E). 


For, if f(x) is measurable on H, then E is measurable and as the 
given domain D is finite, C(#) is measurable. Since f(z) takes the 
value zero at every point of C(£), it follows that C(E)[f(z) = A] 
is measurable. But 


DL f(z) 2 A] = EL f(z) = A] + C(E\L/@) 2 Al 
and hence f(z) is measurable in D. 


TuHeorEeM V. Jf f(x) takes a constant value c at all points of a 
measurable set E, then f(x) is measurable on E. 


This theorem follows at once from the definition of measurability, 
since the points of EH for which f(z) 2 A are identical with E for A Sc 
and zero for A > cc. Hence, in either case the set of points for which 
f(x) 2 A is measurable. Consequently, any constant c is a measur- 
able function. 


TuHroreM VI. [f fi(x) and f2(x) are finite and measurable on E, 
then El fi(x) > f2(x)] is measurable. 


For each value of x for which f(x) > f2(x) there is a rational num- 
ber r lying between fi(x) and f2(z). For any rational number r 
the set of points x for which f,(x) > r > f2(x) is the product of the sets 
EL fi(x) > rj, ELfe(x) < rj and hence is a measurable set, since it is 
the product of two such sets. The sum of these products for all values 
of r is the required set. As the aggregate of rational numbers is an 
enumerable set, it follows that the required set ELfi(x) > fo(a) ] 
is the sum of an enumerable set of measurable sets and is therefore 


itself measurable. 
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Turorem VII. If f(x) is measurable on a set E, then f(x) +c 
and c f(x) are also measurable on E, where c 1s any constant. 
We may write 
EL f(x) +e 2 Ai] = ELf(e) 2 Ai - cl. 
But from the definition of a measurable function, this latter set is 


measurable, since EL f(z) = A] must be measurable for all values of 
A and hence when AMA ae 


Consequently, E[ f(z) + ¢ = A:] is also measurable. A similar proof 
establishes the fact that EL f(x) — c 2 A1] is measurable. 
We may also write 4 
Hef(a) = As] = B| fe) = 


If now we set fa =A, 


it follows from the definition of a measurable function that 
BL se) 2 od and hence E{cf(x) 2 Az] is measurable. 


Cor. If f(x) is measurable on the set E, then — f(x) is also meas- 
urable on that set. 


This proposition follows directly from the foregoing theorem by 
putting 


in the product c-f(z). 
We may generalize Theorem VI as follows. 


c=-—1 


TuHeroreM VIII. [f fi(x) and fo(x) are finite and measurable on a 
set E, then fi(a) + fo(x) and fi(x) -f2(x) are measurable on E. 
We have 
EL fi(z) + felt) > A] = ELfi(z) > A ¥ fr(x)]. 
The function A ¥ f(x) is measurable by Theorem VII. Consequently, 
it follows from Theorem VI that EL fi(x) > A * fe(x)] and hence 
EL fi(x) + fo(x) > A] is measurable. 


It remains to show that f,(2) -fo(x) is measurable. We know that 
{f(x)}? is measurable; for, since A = 0, we have 


EL{f(z)}? 2 A] = ELf(x) 2 VA) + ELf@) s - VA]. 


The two sets in the second member of this equation are measurable, 
since f(x) is measurable on the set E. Consequently, their sum, that 
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is EL{f(x)}? = A], is also measurable. If now we replace f(x) by 
fiz) + fo(x), it follows that {fi(x) + fo(x)}?, {fila) —fo(x)}2 are 
measurable. But we have 


Fiz) -fo(x) = 4L{ Ae) + f(x)? - {filz) — fo(x)}?]. 


It follows from the first part of this theorems and Theorem VII that 
the second member of this identity is measurable and hence the 
product in the first member must also be measurable. 

It follows from the foregoing theorems that every polynomial is 
a measurable function. 


TueorEeM IX. The upper boundary function d(x) of an enumerable 
set {fn(x)} of measurable functions is measurable. A corresponding 
statement holds for the lower boundary function. 


We should observe how the function (x) is defined. For each 
value 2%) we take the least upper bound of the set of values {f,(20)}. 
The aggregate of these values for all values of x in the interval under 
consideration is called the upper boundary function ¢(z). It is 
assumed that for each x a finite upper bound of {f,(xo)} exists; 
for, otherwise the upper bound ¢$(x) would not exist. Suppose now 
that the functions f,(x), n = 1, 2, 3.- - - are measurable on the set 
E. Then, we may write 


EL¢(z) > A] = ELfi(z) > A] + ELfx(z) > AJ+- - 


+ ELfn(x) >Al+ cp ie wee (1) 
Let us put 


EL¢.(z) > Al = EL f(z) > A]—tELA(®) > A]+-:-: - 

PEN jee) Allen = 1,2, 3° = 
The first member of this equation is then measurable, since it is the 
difference of two measurable sets. Equation (1) is equivalent to the 
following: 
Elo(z) > A] = Eldi(z) > A] + Hga(x) > A]+- - 

Oa) 2 Altre 

The terms of the second member are measurable and satisfy the 
conditions of Theorem VI, Art. 21, and hence $(z) is a measurable 


function. 


Cor. If a monotone sequence { fr(x)} of measurable functions has a 
limit, then the limiting function is measurable. 
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Let us consider first the case in which the given sequence is mono- 
tone increasing. For each value of x, we then have 


fila) S frlx) S fale) S++ > Shalt) S-* s. (2) 


The limiting function of this sequence is also the upper boundary 
function of the set {f,(x)} and hence is measurable by the foregoing 
theorem. A corresponding proof holds for a monotone decreasing 
sequence. 


TurorEM X. The upper and the lower limiting functions of any 
sequence of measurable functions are measurable. 


We shall prove the theorem for the upper limiting function. A 
similar proof holds for the lower limiting function. Denote the given 
sequence by {f,(x)}. For any value 2 let F(x) be the upper limit of 
the sequence {f,(zo)}. Then F(x) will denote the upper limiting 
function of the given sequence {fn(x)}. Denote by ¢,(«) the upper 
boundary function of the sequence 


Ia(®), SnehD); OS NR RP Pe th 2, 3, i 


Then the sequence {@,(x)} will have a lower boundary function which 
is the upper limiting function of the sequence {f,(x)}. Each of the 
functions @,(x) is measurable since it is the upper boundary function 
of an enumerable set of measurable functions. Likewise the lower 
boundary function of the set {¢,(x)} of measurable functions is 
measurable. But, as we have seen, this lower boundary function 
is the upper limiting function of the given set {fn(x)}, hence the 
theorem. 


Cor. A limiting function of a sequence of measurable functions is 
measurable. 


This corollary follows from the foregoing theorem; for, when the 
given functions have a unique limiting function that limiting func- 
tion is the common value of the upper and the lower limiting functions. 
Moreover, since the limiting function exists, it is the limiting function 
of any enumerable sequence of the given functions. 

Since every polynomial is measurable, it follows from this corol- 
lary that every continuous function is measurable, since every such 
function can be represented as the limit of a sequence of polynomials. 
It then follows that every function of Baire’s class one is measurable, 
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since every such function can be represented as the limiting function 

of a sequence of continuous functions ; that is, every point-wise dis- 

continuous function is measurable. It may also be shown that a func- 
_tion belonging to any one of Baire’s classes is measurable. 

In the Lebesgue theory of integration, it is of great importance 
that one is able to say that the upper and lower limiting functions 
of a sequence {f,(x)} of measurable functions are measurable even 
though the limiting function has points of discontinuity which may 
be finite or infinite. The following is an illustration. Let 


Nn + nrx 
1 + n2x? 


f n(Z) a 
Then we have for the limiting function, since the upper and the lower 
limiting functions are equal, 


n+ n> 
no 1 + nx 


f(x) = =1, fore ~0, 


= ©, fora =.0. 


The limiting function f(x) is, however, measurable by the foregoing 
corollary, since it is a limiting function of a sequence of measurable 
functions. That f(x) is measurable follows also from the definition 
of a measurable function. 


THeorEeM XI. The function f(x) is measurable on the interval 
(a, b), provided the points of discontinuity of f(x) form at most a set of 
measure zero. 


Consider the set of points EH of (a, b) where f(x) = A, A being any 
finite number. All the limiting points of EH which are not at the 
same time points of # must be points of discontinuity of f(r). By 
adding these points to H we have a bounded, closed set EH’, which 
by Theorem III, Art. 21 must be a measurable set. By hypothesis 
the set of points of discontinuity G of f(x) has the measure zero. 
Hence, the set H;, where 

E, = HE’ — E, 


is also of measure zero, as it is a subset of G. The set H is meas- 
urable, since it is the difference of two measurable sets, and conse- 
quently the function f(x) is measurable on (a, 0). 


1 See Lebesgue, Lecons sur l’intégration, p. 112. 
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THEOREM XII. Suppose f(z, y) to be a single-valued function of x 
and y in the regionaSxSb,y<yxXd. Moreover, let f(x, y) be 
continuous in y and measurable in x for each y ¥ Yo. Then the upper 
and the lower limiting functions of f(x, y) as y approaches yo are measur- 
able functions in x 


For convenience, put 
di(z) = L fey), d2@) = L f(,y). 
yo yo 


In this discussion it is assumed that $;(x), @2(x) exist and are finite. 
We shall show that ¢:(z) is a measurable function. A similar proof 
may be readily formulated for the lower limiting function ¢2(z). 

For any given value of 2, say 2%, the function f(x, y) has a least 
upper bound in the interval (yo, yo + €). As f(z, y) is continuous in 
y this least upper bound is also the upper limit and may be obtained 
by considering only the rational values of y in the interval. The limit, 
as € approaches zero, of this least upper bound is the value of ¢;(2) 
for x = %, and the aggregate of these values for all values of x in 
(a, b) constitutes the upper limiting function @;(x). Let {y,} be the 
set of rational values of y in the given interval. By hypothesis each 
function of the sequence {f(zx, y,)} is measurable in x on the interval 
(a, b). From the corollary to Theorem X, it follows that the limit- 
ing function ¢;(x) is likewise measurable. 

As an important consequence of the foregoing theorem, we have 
the following corollaries. 


Cor. 1. Every derivative number of a continuous function ts meas- 
urable. 


We shall establish this corollary for the upper right-hand deriva- 
tive number. A similar proof holds for the other derivative numbers. 
For convenience, we shall put 


F(z, Ar) = f(v + Av) = f@) 


ne Pe a ey sa TY 


The derivative number D+ f(z) is then the limit of the least upper 
bound of F(z, Ar) as Ax approaches zero through positive values. 
For Ax ~ 0, F(x, Az) is continuous in x and in Az. Moreover, it is 
measurable in x for each value of Ax > 0 by virtue of Theorem IX. 
The function F(x, Ax) satisfies the conditions of the foregoing 
theorem, and hence its upper limit as Az approaches zero, that is 
D* f(x), is measurable. 
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As an illustration, let 
f(z) =2 sin, Heel 
0 
=0 ei: 


This function is continuous and its derivative function is 


; ales 1 
F'(@) = 2x sin = — 5 cos =) x #0, 
= 05 210; 


which by the foregoing corollary must be a measurable function, although it is 
not bounded. 


Cor. 2. Every finite derivative function is measurable. 


If f’(x) is such a derivative function, then f(z) is continuous and 
by Corollary 1 every derivative number of f(x) is measurable. Con- 
sequently, their common values, namely the derivative function, 
must also be measurable. 

The foregoing theorem gives the measure of a limiting function 
f(x, yo) considered as a function of x. The notion of measurable 
functions may be readily extended to functions of two or more vari- 
ables. Thus, f(z, y) is said to be measurable on the two-dimensional 
set EH if E itself is measurable and furthermore if the points of H 


for which Hee) 


form a measurable set, A being any finite number however large. 
The general properties of measurable functions of a single variable 
which are developed in this article can be extended to functions of 
two variables. Thus the sum or the product of two such measurable 
functions is measurable; any function belonging to one of Baire’s 
classes is a measurable function, etc. 

50. Definition of a Lebesgue integral. As already pointed out, 
the Lebesgue integral is based upon the properties of measurable 
functions and the measure of a point set. Let f(x) be a single-valued, 
bounded, measurable function defined for the interval (a,b). For 
the present we shall assume that f(x) is also positive for all values 
of x in the given interval, and later we shall show how the definition 
can be extended to negative functions and to the more general case 
where the integral is taken over a set of points. Let y = candy =d 
be the lower and the upper bounds, respectively, of f(x) in the given 
interval. Instead of dividing the interval (a, 6) on the X-axis into n 
subintervals, as was done in the case of the Riemann integral, let us 
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divide the interval (c,d) on the Y-axis into n subintervals by the 
insertion of the intermediate points yi, Y2,* * * » Yet) Ye» * * * Yn-ty 
as indicated in Fig. 39. 

Let EH; be the set of 
points in the interval 
(a, 6) for which 

Yea = f(t) < Yee 
As we shall see, the 
Lebesgue integral may 
be considered as the 
measure of a_ two- 
dimensional point set. 
Denote by 7, any value of y in the interval (yz-1, yx). Let 


€> (Ye — teas h = 1, 25 ae (1) 


We may now define the Lebesgue integral analytically for the posi- 
tive interval (a, 6) by the relation 


fied: = LE mm(By, Q) 
a e>0 k=1 


Fia. 39. 


Dp 
where, in this case, mE) = 2D One, 
i=l 


as seen from the figure. It will be observed that as € approaches zero, 
the value of n increases indefinitely although the converse may not 
be true. 

We now complete the definition for bounded, measurable functions 
by setting up the convention that 


Jo s@ar = — [se@ae. 


Instead of defining f(x) for the interval (a, 6), it might be defined 
for any measurable set EF of points on the X-axis. In the foregoing 
definition m(E;,) is the measure of the subset of E for which 


Yea Sf(X) < ye 
If the function f(x) satisfies this definition, it is said to be integrable 
in the Lebesgue sense over the set H, where 
E=L > E. 
€>0 k=1 


We shall indicate this integral by the symbol 


if f(x)dz. 
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As we shall see, the effectiveness of the Lebesgue integral as com- 
pared with the Riemann integral is much increased by the fact that 
it may be associated in its applications with functions which are 
defined for a set of points instead of an interval. 

The restriction that f(x) shall have only positive values can now 
be removed; for, all we need to do is to consider separately the set of 
points {x} for which f(x) is negative and then take the algebraic 
sum of this result and the one for positive values of f(z). 

We can now establish the following existence theorem. 


TuroreM. The Lebesgue integral 4 f(x)dx exists of f(x) 1s meas- 


urable and bounded on the point set E. 


To establish this theorem, we must show that the limit given in 
(2) exists under the conditions set forth in the theorem and that the 
limiting value is independent of the manner in which the point set 
{yx} is chosen. 


Let $(n) = B yam(Er), W(n) = % ym(Br). (3) 
We then have é(n) < = num(Ex) < W(n). (4) 


The functions $(n), Y(n) are both bounded and monotone, the first 
being monotone increasing and the second monotone decreasing 
as the length of the intervals (yx-1, yx) decreases by the insertion of 
intermediate points. Consequently, each function has a limit as 
n increases indefinitely in such a manner that € > yz—yx—1 approaches 
zero. These two limits are equal; for, we have 


Y(n) — b(n) = Z(ye — Yea)-m (Ex) < €-m(E). 


Since ¢€ is arbitrarily small and # is measurable and hence m(E) is 
finite, it follows that €-m(Z) is arbitrarily small. Consequently, we 


h 
a L (W(n) - 6@)} =0. (5) 
By Theorem IV, Art. 24, it follows from (4) that the limit 
0 k=1 


exists and is equal to the common limit 


E90) = A = LV). o 
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It remains to show that the value of this limit is independent of the 
choice of the set of values {y,}. Let {y,’} be any other set of points 
in the interval (c,d). Superimpose the set {yz’} upon the set {yx}. 
Some of the points of the two sets may coincide. The remaining 
points of {y,’} may be regarded as the points inserted in the first 
part of this discussion in establishing the limits (6). Hence, if we 
form the functions @’(n) and W’(n) with reference to the set {yn’} 
as o(n) and W(n) were formed from {y,}, it follows that $’(n), 
y'(n) will differ at most by e’ m(£), where e’ is arbitrarily small. 
Denote by W’’(n), ’’(n) the corresponding sums formed from the 
set. {yz’} obtained by superimposing {yx} upon {y/}. Then y’’(n), 
$’'(n) lie between Y(n) and $(n) and likewise between p’(n) and $’(n). 
Consequently, ¥’’(n) can difter from ¥(n) at most by € m(#) and 
from y(n) at most by e’ m(E#). It follows that (nm) and w’(n) can 
differ at most by (€ + €’) m(H#). The same is true of }(n) and $’(n). 
Hence, as the functions approach coincidence, the functions $’(n), 
y’(n) must approach the same limiting value A. The value of the 
limit is therefore not dependent upon the particular manner in which 
the set of points {y,} was chosen. With this conclusion the theorem 
is established. 

In case one knows that the integral exists, its value may be 
determined by either of the limits in (6); that is, by either L ¢(n) 
or L W(n). or sd 


If f(x) is defined for all values of z in a given interval (a, b), is 
continuous throughout this interval, and has only a finite number of 
maxima and minima, it follows from the foregoing theorem that the 
Lebesgue integral exists. As we have already seen, Art. 39, the 
Riemann integral also exists. That the two are equal follows from the 
definition given in (2). For, nz can be replaced by the functional 
value f(&), where ys: S f(&) S yx, and in this case the measure 
m(;) is the sum of the z-intervals composing E;,. We have then 


hee 2 F(&) Ave = L 2 ne m(E;). 


Under the conditions imposed upon f(x), both of these limits exist, 
the first defining the Riemann integral taken over the interval (a, b) 
while the second defines the Lebesgue integral over the same interval. 

The equality of the two integrals is thus shown for a very special 
class of functions. Later we shall see that any bounded function 
which is integrable in the Riemann sense is also integrable in the 
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Lebesgue sense and the two integrals are the same. The converse 
of this proposition, it will be seen, is, however, not true. 

It was pointed out in the last article that every function belonging 
to one of Baire’s classes is a measurable function. We can now say, 
as a consequence of the foregoing theorem, that every such function 
is integrable in the Lebesgue sense, provided it is also bounded. 

One can readily formulate the corresponding definition of a 
Lebesgue integral of two or more variables. Suppose, for example, 
we have given a bounded, measurable function f(z, y) of two inde- 
pendent variables defined for a two-dimensional point set HZ. Then 
one may define the Lebesgue double integral with respect to E by 
the relation 


f iE f(a, y)dady = L > mm(B,), 
E e>0 k=1 


where in this case #; is a two-dimensional subset of H for which 
z = f(x,y) satisfies the conditions 


ta = f(x,y) <u, |%—- wal <«, 


and 7, is any value measured on the Z-axis and situated in the interval 
(2, — 2-1). The existence proof stated in the foregoing theorem can 
be extended to multiple-valued integrals. The proof is analogous 
to that given for the foregoing theorem and is left as an exercise for 
the reader. 

51. Lebesgue integrals of bounded functions. In the present 
article we shall consider only bounded functions. As we shall see, 
the Lebesgue integrals have certain properties analogous to those of 
the Riemann integrals. Among these we have those given in the fol- 
lowing theorems: 


TurorEM I. If the Lebesgue integral it f(x)dx exists, then we have 
if: c-f(a)dz =c [ f(x)dz, where c ts any constant. 
E E 


In the relation given by (2) Art. 50, the factor 7, can be replaced 
by cn, and hence by the laws of limits, we have 


iE, Bee n, m(Ex) =¢ LD ne mE); 
e0 k=1 e—0 
that is, ii of(a)dx=c aL f(x)dz, (1) 


which is the desired result. 
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The Law of the Mean for Lebesgue integrals may be stated in the 
following theorem. 


TuroreM II. If f(x) is bounded and measurable on the set E having 
respectively A and B as the least wpper and greatest lower bounds, then 


B-m(E) < i Wade = Ame 2) 


From the discussion in the previous article, we have 


nr 


(Be Nk A2 Nk) m(E) = L m( Ex). 
e700 k=1 
It then follews that 
B-m(E) $ L = mm(E,) Ss A-m(B), 
1 


e0 k= 


whence from the definition of a Lebesgue integral the required 
relation (2) follows. 
In case A = B = 1, we have the special relation 


[a= m(@). (3) 
TueoreEM III. If f(x) 7s bounded and measurable on a finite number 


or an infinite sequence of distinct, measurable point sets { H,} whose sum 
is E, then 


[sear =f toa fi fede. : +f s@der «he (4) 


Let us first consider the sum of two integrals, that is where £ is 
the sum of the two point sets H;, EH, having no points in common. 
From the definition of a Lebesgue integral we have 


IE fa)jde 1 Denke), 
Ey e>0 k=1 


ff@dr= 1 3 mm(Be). 


By addition, we obtain 
Jfeode +f fade = LS mlm Bs) + mB) 


= a = ne m(E;,), by Theorem VI, Art. 21, 


= ifs f(x)dzx. (5) 
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Instead of the sum of two point sets, we may by the same method 
extend the foregoing result to the sum of any finite number of dis- 
tinct sets. 

We shall now consider the case in which we have the sum of an 
infinite sequence of distinct, measurable sets of points. Denote by 
S, the sum of the first n sets and by R, the sum of the remaining 
sets. The sets S,, R, are both measurable by Theorem V of Art. 21. 
Moreover, since f(x) is measurable on each ZL, it is by Theorem II, 
Art. 49, measurable on S, and R,. Then by the first part of the 
above theorem, we have 


[sear = fi sears f° sae. (6) 
By Theorem X, Art. 21, it follows that 


L m(R,) = m( L R,) =0. 


By aid of Theorem II, we therefore have 


L He f(z)dx = 0. 
Then from (6) it follows that 


[sea pee Jsou 


- f seoraes f sear + 
ue +f feds + - = 


which was to be proved. 
It is to be noted that the foregoing theorem gives a generalization 
of a well-known theorem concerning Riemann integrals, namely: 


fl 1@dr = [sada + [ ra)ae, 


wherea <c<b. 

It is also of interest to note that, while the Riemann integral is 
additive over a finite number of domains of integration, the Lebesgue 
integral is additive over an enumerably infinite number of subdivi- 
sions of the given domain. 


TueoreM IV. [f fi(x) and fo(x) are bounded and measurable on 
the set E and satisfy the relation | fi(x) | S | fo(x) |, then 


fi i@ Lae s fi fle) | ae. 
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For a given 7, let EZ be decomposed into n distinct, measurable 
subsets Hy, H2,...H,,..., En, such that the greatest lower bound 
of | fi(v)| on Ey is m. Since f(x) is bounded and measurable on 
each HE, as well as on £, it follows by Theorem III that 


fine) lar = 3 fl fe) | ae. (7) 
E k=1 SE, 
However, from the conditions stated in the theorem, we have 

fil h@ | de = nm). (8) 


Since the integral f fi(a)dx exists, it follows from the definition of 
E 
a Lebesgue integral that 


f iG) (ee Sore ene: (9) 
E e>-0 k=1 


By taking the sum from k = 1 to & = n of (8) and then allowing € to 
approach zero as n becomes infinite, we have from (7), (8) and (9) 


[ l foe) |de2zL 2 nm) = i | fi(x) | da, 
JE e>0 k=1 E 
as stated in the theorem. 


TurorEeM V. If f(x) 2s bounded and measurable on E, then 


f(a)da | s |_| f(@) | de. 
E E 


Denote by EL; that subset of H where f(x) is positive or zero and by 


E, that subset where f(x) is negative. Then the integrals i) f(x)dzx, 
Ex 


6 f(x)dx are either zero or of opposite signs. The integral in the 


second member of the given inequality is the sum of the numerical 
values of these two integrals while that in the first member is the 
numerical value of their difference. From this fact the theorem 
follows. 


Tueorem VI. Jf each of a finite number of functions fi(x) is 
bounded and measurable on a given set E, then 


J,ch@ tet + felt) ++ + + + fala) Ide = | fiadan + Bar 
E 
+ fipeode +--+ f' tare 
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It is sufficient to prove the theorem for the sum of two functions; 
for, by repeating the process we can extend the results to the sum of 
any finite number of functions. Each of the given Integrals exists; 


for, since f.(x) is bounded and measurable on EF, then 2 P&) is 
bounded and by Theorem VIII of Art. 49 it is also ecerabTe: 
Let us first consider the integral fe [f(x) + A]dz, where A is a 


constant. Denote by ¢:(n) the particular value of @(n) defined by 
(3) of Art. 50 for [f(~) + A] and by ¢2(n) its value for f(z). We 
then have 


gi(n) = 2 Gea + A)m(Ei) = 2 yam(Ey) + 2 Am (E;) 


n 


= 2 yxim(Ei) + Am(E) = $2(n) + Am(E£). 


Upon passing to the limit as in Art. 50, we have 


J Ci@ + Alde =f seeds + Am), (10) 


Let us now consider the integral of the sum of two functions, fi(«) 
and fo(x), each being bounded and measurable on the point set H. We 
have, if we think of EH as decomposed into n distinct, measurable sub- 
sets HZ; corresponding to the functional values yi < fi(z) S ys, 


Eft hele, a) 


IV 


[tn@ +h@Me 
E 


IA 


fUn@) + hayes 3 filet h@le (12) 


But by (10) we have 


Ji (ur + fade = fj, P@de + px m(BD, 
Jun + fle) Me - J, pe@rde + ye mE) 


Making use of Theorem III, we have from (11), (12) 
f plarae + 3 yom(ey) = fi CAC) + flo) Ve 
> ie flo)de + 3 yeam(Bs). (13) 
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As n becomes infinite in such a manner that € > (yz — ys-1) approaches 
zero, it follows that 


Ms 


yum(E,), D yram(Ey) 
k=1 k=1 


both approach the same limit, namely He fi(z)dx. Hence, from 
Theorem IV, Art. 24, we have from (13) “1 


fi@ thee = pe@de +f fear. 


The theorem is thus established. 
The following theorem gives the conditions under which the fore- 
going theorem may be extended to an infinite sequence of functions. 


TuHEorEM VII. Let {f,(x)} be an infinite sequence of measurable 
functions defined for the set of points E. Moreover, suppose these func- 
tions to be bounded on this set; that is, simultaneously for all values of x 
in E and all integral values of n. If {fn(x)} converges to the unique 
limiting function f(x) as n becomes infinite, then we have 


Lf tula)de = fi fae. 


As each function of the sequence {f,(x)} is measurable, it follows 
from the corollary to Theorem X of Art. 49 that the limiting function 
f(x) is measurable. It is also bounded, since f,(x) is bounded when 
considered as a function of x and n together. In order to establish 
this theorem, it is sufficient to prove that the integral 


J, Cia) - 10) ae 


converges to zero as n becomes infinite. 
As both f,(z) and f(x) are bounded and measurable, then 
{fn(z) — f(x)} is also bounded and measurable on the set E. It 


follows that the integral if Lfn(z) — f(x)]dx exists. Denote by © 
E,,n = 1, 2,3,- + +, the points of H where 
| fa(z) — f(z) | <e. (14) 


Since {fn(x) — f(x)} is bounded on E, we have for the complementary 
set of H,, namely C(£,), 


| fn(z) — fz) | <M, (15) 


where M is a definite number. We may write 
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| fi ciate) —seeytee | = [Ie — 700) | ae 
S em(E,) + M-mC(E,). (16) 
Upon passing to the limit, we have from Theorem DAT. 21, 


L m(E,) = m(£), 


and hence L mC(E,) = 0. 
Consequently, from (16) we obtain, for arbitrarily small values of 
€, «: and for n sufficiently large, 


J Cine) - Hayles 
and hence L i) Cfn(z) — f(x) ]dx = 0, 
now EF 


which establishes the theorem. 

The foregoing theorem can be readily extended to functions of two 
or more variables. This theorem shows an important distinction be- 
tween the Riemann and the Lebesgue integrals, namely: In the fore- 
going theorem merely the convergence of the sequence {f,(zx)} of 
bounded functions is sufficient for the conclusion that the additive 
property of the integral with respect to the integrand shall be valid, 
while in the case of the Riemann integral, on the other hand, the 
sequence {f,(x)} must converge in a special manner, namely quasi- 
uniformly in general. 

As a consequence of the foregoing theorem, we may state the 
following corollary. 


< e-m(E) + 4, 


Cor. If the sequence {f,(x)} of functions measurable on E has a 
limiting function f(x), then 


Lf fua)dr = f fte)ae, 


provided all the elements f,(x) of the sequence have the same finite bounds. 


52. Comparison of Riemann and Lebesgue integrals. Suppose 
f(x) to be defined for the interval (a, b), and in this interval let it be 
single-valued and bounded. The question presents itself as to whether 
the existence of the Riemann integral implies the existence of the 
Lebesgue integral and conversely. As already pointed out, an 
essential difference between the two is that in the Riemann integral 
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the interval of integration is subdivided while in the Lebesgue integral 
the subdivisions are taken on the axis of the dependent variable in 
stating the definition of an integral. The answer to the foregoing 
question for bounded functions is to be found in the following 
theorem. The case of non-bounded functions will be discussed in 
the following article. 


Tunorem: Let f(x) be defined for the interval (a, b) and for this 
interval suppose it to be single-valued, bounded, and integrable in the 
Riemann sense. It is then integrable in (a, b) in the Lebesgue sense, 
and the two integrals are equal. The converse, however, 1s not necessarily 
true. 

Within the interval (a, b) consider the set of points H where f(x) >A, 
A being any finite value. This set may contain both points at which 
f(x) is continuous and also points of discontinuity of f(z). From the 
nature of continuity, each point of # at which f(x) is continuous is an 
inner point of /, since there must exist a neighborhood of such a 
point in which f(z) > A for all values of zx. The points of # which 
are points of continuity form then an open set. Since f(z) is integrable 
in the Riemann sense, it follows from Art. 42 that the points of H 
where f(x) is discontinuous form at most a set of measure zero. Then 
from Theorem V, Art. 21, we know that H is a measurable set; for 
it is the sum of two measurable sets. Consequently, f(x) is a meas- 
urable function on (a, b), and since f(a) is also bounded, it follows by 
the theorem of Art. 50 that it is integrable in the Lebesgue sense. 

We shall now show that the two integrals are equal under the 
conditions set forth in the theorem. Let the given interval (a, b) be 
divided into subintervals 

Aye = % — 2%, 


and denote by Az, B; the least upper and the greatest lower bounds, 
respectively, of f(x) in A;,(x). By Theorem II of the last article the 
Lebesgue integral satisfies the following condition, since the measure 
of an interval is its length, 


B;, Ay« = Lebesgue ‘li wy f(a)da S ApAye. 


Summing up the products formed for all the intervals Azz of 
(a, b), we have 


n b n 
RJ B, Ayx S Lebesgue f f(x)dx S 2 A; Aye. 
b= a k=1 
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As n becomes infinite i in such a manner that the norm Az approaches 

zero, 2 B, Ayxz, 2A;,Axx have as their common limiting value the 

mienace integral from a to b. From Theorem IV, Art. 24, it then 

follows that the two integrals are equal for eaten Aincnone when- 
_ever the Riemann integral exists. 

The converse of the foregoing theorem is not true; that is, a 
Lebesgue integral of a bounded function may exist in an interval 
(a, b), while the Riemann integral does not exist. For example, let 
f(x) be defined for the interval (0, 1) as follows: ; 


f(x) = 1, for rational values of z, 
= 0, for irrational values of z. 


This function is totally discontinuous in the given interval and hence 
has no integral in the Riemann sense; for, as we know, the necessary 
and sufficient condition for the existence of such an integral is that 
the points of discontinuity shall form at most a set of measure zero. 
In this case the measure of the set of points of discontinuity is one. 
The function f(x) is bounded and measurable on the set F, of rational 
points and also on the set H, of irrational points. Consequently, by 


the Theorem of Art. 50, the Lebesgue integrals [ f(x)dz, 2, ae 
both exist. From Theorem III, Art. 51, it follows that the enews 
integral [ f(x)dx taken over the interval (0, 1) must exist. 


53. Lebesgue integrals for non-bounded functions. The 
Lebesgue theory of integration may be extended to certain classes of 
measurable functions which are not bounded.!. To do this let f(z) 
be any measurable, non-bounded function defined on the bounded, 
measurable set of points #. For the present, we shall also assume 
that f(z) is not negative. Let k be any one of the sequence of posi- 
tive real numbers, ee ay ee (1) 


having no finite upper bound. We shall define the auxiliary function 
fx(x) by the inequalities 


f(x) = f(x), where f(x) = k 
= k, where f(x) > k. 


The function f;,(z) is then bounded and measurable on the set of points 
E. Consequently, the Lebesgue integral if fx(xz)dx exists for all: 


1See, Lecons sur Vintégration, p. 335; also de la Vallée Poussin’s Intégrale 
de Lebesgue, p. 45. 
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values of k. If the limit of ls fi(xz)dx exists as k becomes infinite 


through the succession of values given in (1), then we say that the 


y=f (x) integral Z f(x)dx exists, and 


we write 


fis@ar= Lf falar. 2) 


If f(x) is negative for all 
_ _ points of H, we say that the 
o Lebesgue integral exists on H 


Fig. 40. if the limit L i | f(x) | dx 
kood E 


exists as k becomes infinite through the sequence of values given in (1). 
If, however, f(x) is negative for some points of H and positive at 
others, we may define the Lebesgue integral by the relation 


f,i@dn =f, iad — ff fuladae, 3) 
where fi(z) = f(x), f f(z) 20, f(x) = f(x), if f(z) < 0, 
= 0, if fi) < 0, = 0, if f(z) = 0. 

Of course, it is assumed that the functions fi(x), fo(x) thus defined 
are measurable and their integrals exist in accordance with the fore- 
going definition. 

If the function f(x) satisfies the above definition, it is said to be 
summable on the set of points H. This term is sometimes applied 
also to bounded functions satisfying the conditions of a Lebesgue 
integral. Summability thus plays the same réle in the Lebesgue 
theory of integration as integrability does in the Riemann theory. 
The notion of summability can be extended to the case where f(z) 
is defined for non-bounded sets E. 

As a consequence of the foregoing definition of summability, it 
follows that if f(z) is summable, then | f(x) | is also, and conversely 
if | f(x) | is summable it follows that f(x) is summable. Moreover, 
any summable function can be written as the difference of two non- 
negative functions f,(x), f(x) which are summable in the Lebesgue 
sense. Hence, in the discussions to follow we may, without loss of 
generality, assume f;,(x) = 0, since all other cases may be made to 
depend upon this one. 

Some of the special properties of summable functions are given in 
the following theorems. 
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TueoreM I. If f(x) is summable on the set E, then the subset of E 
where f(x) becomes infinite has the measure zero. 


From the foregoing discussion, f,(z) is bounded and measurable. 
Moreover, we have from the definition of a summable function 


ff@dz= Lf fleas =A, (4) 


where A is a finite number. Denote by E; the subset of E where 
f(z) = k and by E; the subset where f(z) > k. We have then 


EK = H,+ Es. 
From (4), together with the definition of a Lebesgue integral, we 
have 
a= 2, funtiies {json} 


I| 


L { fi feo ide + k mB) \. 
Since k and f,(z) are both positive, it follows that 
A2=km(f,). 


The value of k is not bounded, and if it is allowed to increase in- 
definitely the value of m(HZ:) must become arbitrarily small. We 
may then write with the proper selection of k 

m(E2) < €, 
and consequently in the limit the measure of EH» is zero as k be- 
comes infinite. 


TuHeorEM II. Jf f(x) is summable on the point set E, then it is 
summable on any measurable subset of E. 


Let EL; be any measurable subset of HZ. We have by hypothesis 
the condition that 
fs@ar= Lf foae, 


to prove that the limit WE ifs fi(x)dx (5) 


exists, where f;,(z) is defined as in the definition of a summable 
function and is assumed to be non-negative. 

Since F, is a subset of E, it follows that f,(z) defined for the set Fy 
can not exceed, for any value of z, the value of f,(x) defined for the 
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point set Z. As E, is by hypothesis measurable, it follows from the 
definition of f,(z) that it is a bounded, measurable function on the 


set H,. The integral } f,(x)dz then exists and 
Ey 


fi p@oac s fi filaae 


Both integrals represent monotone functions of k and the second 
converges by hypothesis to a finite limit as k increases indefinitely. 
Consequently, the first integral is bounded and monotone and must 
therefore converge to a finite limit as k increases without limit; 
that is, the limit (5) must exist as the theorem requires. 


TueoreM III]. Suppose f(x) to be summable on the set of points 


E and let E, be any measurable subset of E. The integral ip f(a)dx 
tends to zero with the measure of E,. ; 


It is sufficient to consider the case where f(x) is non-bounded and 


non-negative. 
From the definition of summability, we may then take k sufficiently 


large so that 
[ie@u < f fele)ae + €, 


where € is an arbitrarily small positive number. Since F;, is a meas- 
urable subset of LH, it follows from this relation that 


f sora ZA fi(a)dx + €. (6) 
The value of f(z) never exceeds k; therefore, if we have 
m(E) << p 


it follows that the integral if fi(x)dzx is less than e€, and hence from 
(6) we have = 


i f(x)dx < 2e, 

Fx 

where 2¢ is arbitrarily small. In other words, the integral f f(x)dx 
A, 


tends toward zero as € and therefore m(E,) approaches zero. 

The foregoing theorem is equivalent to saying that the integral of 
f(x) is an absolutely continuous function of Fy. 

It is of interest to note how many of the properties of Lebesgue 
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integrals discussed in Art. 51 can be extended so as to apply to any 
summable function. It becomes at once evident from the definition 
of summable functions that Theorems I-VI can be so extended by 
merely substituting in those theorems the term “ summable” for 
“bounded and measurable.” The proofs depend upon the use of 
the laws of limits and may be supplied by the reader. 

Theorem VII of Art. 51 does not permit of a corresponding ex- 
tension without some modification. We shall introduce the notion 


of equi-absolute continuity! of the integrals i: fn(x)dx, where {f,(x)} 


is an infinite sequence of summable functions. These integrals are 
said to be equi-absolutely continuous on the set Z, if to every positive 
€ there corresponds a positive number 6 such that for any n we have 


| ff fo@ax 


where e is a measurable subset of H having a measure less than 6. 


< & 


It is important to notice that in case the integrals dr fn(x)dx are 
equi-absolutely continuous on the bounded set H, then the integrals 


4p fn(z)dz are bounded for al] values of n. In fact, HE may be divided 
B 


into a finite number of sets each having a measure less than 6 and the 
integral on H may be divided into the same finite number of integrals 
each in absolute value less than e. 

With the aid of this property, we may state the following theorem. 


TuHErorEM IV. Let {f,(x)} be a sequence of summable functions, 
bounded or not, having f(x) as its limiting function. If the integrals 


f.(x)dzx are equi-absolutely continuous on E, then f(x) ts summable 
on E. 


It is sufficient to demonstrate the theorem for the sequence 
{| fn(z) |}. For, to say that the integrals of the given sequence 
are equi-absolutely continuous is equivalent to saying that those of 
the sequence {| f,(x) |} are also, since we can always consider only 
those subsets HZ, for which f(x) does not change sign. Moreover, if 
the sequence {f,(z)} approaches f(x), then the sequence {| f,(x) |} at 


1 See Vitali, Rendiconti del Circolo matematico di Palermo, Vol. 23 (1907), 
pp. 137-55. Also de la Vallée Poussin, Trans. Amer. Math. Soc., Vol. 16 (1915), 


pp. 435-501. 
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the same time has the limiting function | f(x) |, and consequently 
f(z) is summable whenever | f(x) | is summable. 

In accordance with the foregoing statements, let us assume that 
both f,(x) and f(z) are either positive or zero. If k is any finite num- 
ber, then we define [f,(x)_, to be equal to f,(x) whenever f,(z) is less 
than k and equal to k for those values of x for which f,(x) 2 k. 
Let f(x) be defined in the same manner. Then both [f,(x)], and 
f(x) are bounded and [ f(x) _), approaches f;,(x) as a limiting function. 
From Theorem VII of Art. 51, we have 


fide = Lf Cede. 
Since [fa(z)k S fn(x), we have 


Jith@k sf faloae. 


However, the integrals f, fn(x)dx are bounded as a consequence of the 
hypothesis that the integrals | f,(x)dz are equi-absolutely continuous 


on HE. There must then exist a finite number M such that for all - 
values of k we have 
if file)de < M. 


The integrals {i f.(x)dx are monotone increasing functions of k. 
Since these integrals are bounded, it follows that the limit 


— J, Ie (2) ues 


must exist, and hence the function f(x) is summable. 


TuroreM V. Let {fn(x)} be a sequence of swmmable functions, 
bounded or not, having f(x) as rts limiting function. If the integrals 


ik fr(a)dx are equi-absolutely continuous on the set E, then 


ae 1b fr(a)de = eff ae. 


From Theorem IV, it follows that f(x) is summable, and hence 
it must be finite except for a set of points of measure zero. More- 
over, the integral of f(x) is equi-absolutely continuous, by virtue of 
Theorem IJ]. 
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The value of the integral of any of the functions 


fi(z), f(z), a eagee fa(z), Sas) f(z) (7) 
is not affected by omitting from E those points where the function 
becomes infinite, because such points form at most a set of measure 
zero. For the purposes of our demonstration, we may therefore as- 
sume that these functions are finite. 

Set up the function ¢,(x) = | f,(z) — f(x) |. Asn becomes infinite, 


n(x) has the limiting value zero. Moreover, the integrals ne bn(x)dx 
are equi-absolutely continuous on the set Z, since that is true of the 
integral Af f(x)dx and by hypothesis of the integrals ak f.(x)dx. The 
theorem will be established if we can show that 


L bn(z)dz = 0. 
E 


Let Mi, Mz, Ms,- - -, Mi,- - - be an increasing sequence of 
positive numbers having no finite upper bound. Denote by E; the 
set of those points where at least one of the functions ¢,(x) exceeds 
in absolute value the number M,;. It follows that m(E,) approaches 
zero as k becomes infinite, since this measure is that of the set of 
points common to the sequence {#;} for all values of k, and there 
are no such common points. 

We may write for all values of n 


Ji on@az = ae bn(x)dx +f ,(x)dz. (8) 
We have L i. es o,(2)dx = 0; 


because, for every arbitrarily chosen € there must exist a k such that 
for the corresponding point set (H — E,) we have for all values of n 


sufficiently large 


Sopp, alodae <€. 
We may also write L . d(z)dx = 0; 


for, these integrals are equi-absolutely continuous and hence they 
must approach zero with m(H;), which, as we have seen, has the limit 
zero. Hence, from (8) we have the desired result upon passing to the 
limit, namely, 

L 2 ona) = 0). 


nO 
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Turorem VI. Let {f,r(x)} be a sequence of summable functions 
having f(x) as its limiting function. If we have on the point set E 
alot < $(z),n = 1 2, 3, ha i> ow) 
where (2x) is a positive, summable function, then f(x) is summable and 
D Ct ae tp Fiayae 
nod EF E 


As before, we shall prove the theorem for the case where f,(z) is 
non-negative. The result can then be extended to the general case 
since all such cases can be expressed as the difference of two non- 
negative functions. 

By hypothesis we have 


ate). | < $(z), n =1, 2, 3, a eee: (9) 
where (xz) is summable on the given set H. From the summability 


of (x) it follows that 
fi b(z)dz < €, (By Theorem ITI) 


where é is a suitably chosen, measurable subset of H. From (9) it 
follows that 
ff Salada 


that is, the integrals aL f,(x)dz are equi-absolutely continuous. It fol- 
lows then from Theorem V that 


L ee = f feae. 


no 


<< GE 


TueorEM VII. Let {f,(x)} be a non-decreasing sequence of ‘positive 
functions having the limiting function f(x), which may be finite or in- 


finite. Then we have 
L ee - f sods, (a) 


no 


However, if f(x) 1s not summable, then both members of this equation 
become infinite. 


If f(z) is summable, this theorem reduces to the preceding 
theorem; for, all we need to do is to replace f(x) by $(z) as used in 
that theorem. 

If f(x) is not summable, define f,(x) to be equal to f(x) wherever 
f(x) 1s less than k, k being any finite number, and equal to k for those 
points of EH where f(x) is equal to or exceeds k. Let [fn(x), be de- 
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fined in a similar manner. Then just as in the demonstration of 
Theorem IV, we have 


Jha Lf Crerde s bf pteyae. 


The first integral in this inequality becomes infinite with k. As {fn(x)} 


is non-decreasing and independent of k, it follows EES L fn(a)dx 
becomes infinite as the theorem states. a 


THeEoREM VIII. Let {f,(x)} be a sequence of non-negative, sum- 
mable functions having the limiting function f(x). A necessary and 
sufficient condition that f(x) is summable and also that 


[fod = 1 _ of fled (10) 


ts that the integrals ap fn(x)dx are equi-absolutely continuous on the 
point set HE. 

We have already seen that the given condition is sufficient; that 
is, if the integrals f f,(x)dz are equi-absolutely continuous, then f(z) 
is summable and equation (10) follows. It remains to show that the 
condition is necessary. 

Assuming that f(z) is summable and that equation (10) is valid, 
we must show that the integrals } f,(x)dx are equi-absolutely con- 
tinuous on EF. We shall do this by showing that if the integrals 

f.(x)dx are not equi-absolutely continuous, then the relation ex- 
pressed by (10) is not valid. 

Let Mi, Mz,- - -, Mi, - + - be a sequence of positive numbers 
which increase without limit and let HE; be that subset of H where 
at least one of the functions f,(x) exceeds M;,. It follows that m(H,) 
approaches zero as k becomes infinite since it is the measure of a set 
of points common to the sets of the sequence { H;}; that is, of a set 


of points where f(z) becomes infinite. ; 
As it is assumed that the integrals | f,(x)dx are not equi-abso- 


lutely continuous on £, it follows that we may select an € such that 
however small the positive number 6 may be chosen we have 


f toloraa > 6, (11) 


1 See de la Vallée Poussin, Trans. Amer. Math. Soc., Vol. 16 (1915), p. 447. 
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where e is a subset of H and of measure less than 6. It is to be ob- 
served that the integrals f fn(x)dx are, however, equi-absolutely con- 


tinuous on the complementary set C(x) where the functions f,(x) 
are bounded. We may then conélude that for all values of & and for 
a sufficiently large value n we have 


ff fAvjdx >. €. 
Ex 


Because the integrals ay fr(z)dx are equi-absolutely continuous on 
the point set C(Z;), it follows from Theorem V, that _ 
L i Anda i, f(x)dz. (12) 
nc C(Ex) C(Ex) 


Consequently, we have 


ue ee _ as Joc SO% : — Ip Jale)ae 
> J gf@drte 


Upon passing to the limit as k becomes infinite, we have 


L ned = [s@de +e. 


This conclusion contradicts the relation expressed in (10). Hence 
the assumption that the integrals | f,(a)dz are not equi-absolutely 


continuous on £ is not valid, and from this contradiction the given 
theorem follows. 

54. Indefinite Lebesgue integrals. As with Riemann integrals, 
we may define the indefinite integral }(x) by the relation 


eG) = [Fedz, ase sb, () 


where we assume f(x) to be a single-valued, summable function, but 
not necessarily bounded in the interval (a, b). As we shall see, the 
value of (x) is then determined except as to an additive constant. 
Lebesgue * has generalized the notion of the indefinite integral by 
replacing the subinterval (a,x) by any measurable subset of E, 


1 See Encyclop. der Math. Wiss., Bd. Ts, p. 113; also Lebesgue, Ann. Ecol. 
Norm. (3), Vol. 27 (1910), pp. 361-450. 
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of the given point set E over which the definite integral is taken. 
Thus, we may put 
(By) = f fla)de, 


where $()) is defined as the generalized indefinite integral. 
Some of the more important properties of indefinite integrals are 
stated in the following theorems. 


THeEoreM I. Let f(x) be a summable function in the interval (a, b). 
Then the indefinite integral 


d(x) = [ sear, ren Css) 
is an absolutely continuous function. 


Let {Zz} be any finite or enumerably infinite set of subintervals 
lying in the interval (a, b), made by the insertion of a set of inter- 
mediate points {z;,} between a and b. We may then write 


I, = % — Ga, UT, =1, Ard(z) =|[ f(x)dz. 


Making use of this notation, we have 


Z| A.ba)|=Z) f fedaels fis) |ae. @) 


By Theorem III, Art. 53, this last integral, however, approaches zero 
with the measure of the set {J,}, that is with the measure of J. The 
first term is the sum of the absolute values of the differences of $(z) 
in the set of intervals {J}; that is, 


2 | A.d(z) | = 16) - 6(@) 14+ 1 o(@)-d@)|+---, 


where the points of the set {z;,} are arbitrarily chosen in the interval 
(a, b). It follows from (2) that the sum of the oscillations of (zx) in 
any set of intervals {J;} in (a, b) approaches zero with the sum of the 
lengths of these intervals. This is the condition that the indefinite 
integral ¢(x) is absolutely continuous in (a, 6). 


Cor. If f(x) ts summable in the interval (a, b), the indefinite integral 
(0) = f addr 
ts a continuous function. 


This proposition follows as a special case of the foregoing theorem. 
For, if d(x) is absolutely continuous, it is necessarily continuous. 
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Turoreo II. Let f(x) be a summable function in the interval (a, 6). 
Then the indefinite integral 


o() = f fads, asz st, (3) 


is of limitied variation and its total limited variation in (a, b) 1s 


J \s@ Laz. 


That (x) is of limited variation follows from Theorem I; for, 
being absolutely continuous, it follows from Theorem VII of Art. 38 
that it must also be of limited variation. 

We shall now find an expression for the total variation of @(x) in 
the interval (a,b). Divide the interval (a, 6) in any manner into 
consecutive intervals. Denote by (a) those subintervals where 
the integral | f(x)dx is positive and by 6 those where the integral 


uF f(x)dx is negative. Using the notation of Art. 38, we may write 


p=E f fads, n= -2 f fa)as, 
and the variation V of $(x) is then given by 
V=pt+n. 


If we denote by E, the set of points where f(x) 2 0 and by FE, the 
set where f(x) < 0, then if, as in Art. 38, P and N denote the least 
upper bounds of p and n, respectively, for all possible methods of 
subdivision of (a,b), we have 


P< if SG@az, Ns - ff f(e)de. (14) 


We shall now show that ls f(x)dx can not exceed P. A similar 
argument can be readily formulated by the reader to show that 
= i f(x)dx can not exceed N. 


As E, is measurable, it can be expressed as the sum of a closed 
set and one whose exterior measure is less than an arbitrarily small 
number €. Hence, by the aid of the generalized form of the Heine- 
Borel Theorem applied to the closed subset of Z,, we can enclose the 
points of EH, in a set of intervals 6, whose measure can be made to 
differ from that of H, by as little as we please. We may therefore 


it 
ae fh ede = a fiers ip sieahiee 
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where m(62) and hence the integral i f(x)dx is arbitrarily small. 
As the integral in the first member of this equation expresses a value 
of p for the intervals 6,, it follows that ap. f(x)dz can not exceed the 


least upper bound of all values of p; namely, Ee 
Hence, we obtain by aid of (4) 


Veo Ps if or fb S@de 


= [| s@) lac. 


THeorREM! III. Jf one of the derivative numbers of a continuous 
function f(x), say D*f(x), is bounded in the interval (a, b), we have 


f(z) — f(a) = Hi “DY(@)dr, aSa2b, 


and f(x) has a finite derivative at all points of (a, b) with the exception 
of at most a set of measure zero. 


The derivative number D*f(x) is bounded and by Cor. 1 to Theorem 
XII, Art. 49, it is also measurable, and hence it is summable. 

Let the indefinite interval (-«, ~) on the axis of ordinates be 
divided into subintervals (/,, ln41) such that we have 


Liat aa La <4 € 


as n takes all positive and negative integral values and zero, and let 
l,=0. Denote by e, the points of (a, b) where l, < D*f(a) Slay: and 
arrange the sets e, in the order 


€0, @1, C=Iy 2, é_2, Seer: ta En, €_n Rg tas 
Select a set of positive numbers a, less than 1, such that 
dotal{[h|tanllil+---+oan[4|[+tan|Lalt+--- 


is less than e. 

Inclose é in a set of non-overlapping intervals Ao, and inclose the 
complementary set C(é) in a set of intervals J) chosen in such a 
manner that the measure of the parts common to Ao and Io shall 
not exceed ao. Likewise inclose e, in a set of intervals A; and 


1See Lebesgue’s Lecons sur Vintégration, pp. 120-3; also Atti det Lincet 
Rendiconti, (5) Vol. 15 I, pp. 488-8, 551-8, 674-84; Vol. 15 II pp. 3-8, 358-68; 
Vol. 16 I, pp. 92-100, 283-90. 
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C(eo+e:) in a set of intervals J,, such that the common parts of these 
intervals shall have a measure not greater than a; and both A; and 
I, shall lie within J. Proceeding in this manner, we inclose eé,, 
where n may be either positive or negative, in a set of intervals 
A, and C(eote: +: + + + én) in a set of intervals J, such that the 
measure of the parts common to the two sets shall not exceed a, 
and both A, and J, shall lie within J,_1. 


It follows that m(A,) — M(en) S an, 


and A, has in common with all other A’s a set of intervals whose 
measure does not exceed 


GQtat:::+a,35 Nx. (5) 
Since zl mA, )—2| 4, | me) 3 2 la (6) 


we see that 2 | 1, | m(A,) and 2| 1, | m(en) are both convergent or 
both divergent, and in the former case the difference is less than e. 
For each e,, we have 


[in| —e€ < Dtf(@) < |L [+e 
and hence 


Si cea) < f DY@)dz ZE1b | med hee ae 


Each z in (a, b) is a point in some e,. Let A,’ be that interval of 
the set A, which contains z. Let (x, x + Az) be the longest interval, 
of length not greater than e, to the right of z contained in A,’ and 
satisfying the condition 


(a ee is 


whence 


Ar{|1, | — e} $ f(@@ + Az) — f(z) s Ax{|l, | + €}. 


We may cover the interval (a, b) by a chain of intervals (z, x+ Az) 
beginning with a. For the left-hand end-points x which belong to the 
same én, let B, be the intervals of the corresponding part of the chain. 
For that part of the chain for which n < N, where N is finite, we 
have 


2 [la] m(B,) ea) 5B Uflw + An) — f(2)} 


n=1 


< | 1. (Bot eboayenG) 
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The points of A, which are not a part of B, form a part of a set A 
(p ~ 0), and their measure can not exceed Np. Hence, we have 


n+p 
N N N 
2 [tn | m(An) — 2 bts (nl Ba) S Zyl bel Ws. 
n= n= n=1 
The values of a, can be so chosen that 
N 
z lane 6) 
whatever value is given to N. We then have 
N N N 
Zz! Li mA.) er = bin jm B,) = 2 | l, | m(Bn)+e. (9) 
For all values of n, we have 


m(An) = m(en) 2 m(B,), 


V 


and hence obtain from (8) 
z | ln | men) —€(b-a+1) < z fae Az) — f(x)} 
<2 |b | m(én) + €(b —a +1). 
For values of N sufficiently large, the difference between z \ln | m(En) 
and z ! l, | m(en) is less than €. Hence, we have 
> | I | m(én) — e(b—a + 2) < Dif(z + Az) — f(x)} 
<2Z|l,|m(en) +€(b-—a+2). (10) 


By comparing (7) and (10), it follows that f(b) — f(a) lies between 
the values 


'b b 
[Dii@de— <b -a+3), [ Def e)de +b - a +3). 


Since this relation holds for every choice of € however small, it fol- 
lows that for a S$ x S b, we have 


f(x) — f(a) = df * D+(a)de. 


A similar proof shows this relation to hold for each of the other 
derivative numbers. We may then write 


f(a) - f(a) = ["D*f(a)de = f"D.feoas = ["D TH me 
2)AL. 
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Because these integrals all exist and are equal, the integrands must 
be equal at all points of (a, 6) with the exception of at most a set of 
measure zero. Hence, f(z) must have a finite derivative at all points 
of (a, b), except for a set of at most measure zero, as the theorem 
requires. 

Cor. 1. Every bounded derivative is summable. 


This corollary follows as an immediate consequence of the fore- 
going theorem; for, if f(a) has a bounded derivative at every point 
of (a, b), then it is necessarily continuous and the conditions of the 
theorem are satisfied. 


Cor. 2. Every bounded derivative number of a continuous function 
f(x) ts summable. 


As we have seen, if f(x) has a bounded derivative number, then 
all the derivative numbers of f(x) are bounded and the corollary fol- 
lows from the foregoing theorem. 


Turorem IV. Let f(x) be a summable function in the interval 
(a,b). The indefinite Lebesgue integral 


o (2) = f sear 


has f(x) as its derivative at all points of (a, b), except at most at a set 
of points of measure zero.' 


Let us first consider the case of a measurable function f(x) which 
takes only the values zero and one. Let (x) be the corresponding 
indefinite integral. Let E be the set of points for which f(z) takes the 
value one. Inclose the points of # in a set of intervals A;, the sum 
of whose lengths is m(H#) + &, where & approaches zero as k in- 
creases indefinitely. Denote by E, the set of points common to the 
sets of intervals AeA Pe ee 

ly 2) ’ ky 


Then £ is contained in E,; and differs from it by a set of points of 
measure zero. In the calculation of (x), we can replace f(x) by 
another function fo(x) of such a character that it takes the value one 
at the set of points Z;. Let f,(x) be a function which takes the value 
one at all points of A;, being zero at all other points. Then fo(z) is 
the limit of the decreasing functions f,(x) as k becomes infinite. 
Denote the indefinite integral of f.(x) by x(x). For a positive incre- 


1 See Lebesgue, Lecons sur V’intégration, p. 124. 
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ment of z, the increment of ¢;(z) is at least equal to that of (a). It 
then follows from the definition of a derivative number that 


Dox(x) = Do(z) 2 0, (11) 


where D denotes any one of the four derivative numbers. 
To compute the value of D¢;(x) within A;, we have from the defi- 
nition of ;(zx) 


NC tO aa flee - J pcoae| 


ie = hi fated 


Since f;,(x) is one for all values of x within A;,, this integra: reduces to 
Az, and we have for all such values of z, irrespective of the values of 
ae Gila + Ar) - d(x) _ | 

Az > 
Hence, within this interval Dd;(x) is equal to one for each value of 
x; that is, at all inner points of A,. Consequently, we may conclude 
that Dd;(x) is different from zero at the inner points of A, and at 
other points which, as k becomes infinite, form a set of measure zero. 
From (11) it follows that D@(z) can be different from zero only at the 
points of F, (or of #) and otherwise at a set of points having the 
measure zero. 

The values of D(x) are bounded since by (11) they can never 
exceed the values of Dd;(x) which are at most equal to one. More- 
over, D(x) is measurable since $(z) is continuous by the corollary 
to Theorem I. It is therefore summable. The conditions of Theorem 
III are satisfied, and we have 


J 09@) de = 6) - 60, (12) 


Since f(x) is zero or one we have 
$(b) — (a) = m(£). (13) 


From (12) and (13) we may conclude that D¢(z) is equal to one for 
all points of HZ with the exception of at most a set of points of meas- 
ure zero. These relations hold for all the derivative numbers, and 
hence we can say that f(z) is the derivative of ¢(x) with the excep- 
tion of at most a set of points of measure zero. J 

We shall now consider the case in which f(x) is a bounded, meas- 
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urable function. Denote by L and 1 the least upper and the greatest 
lower bounds respectively of f(x) in the interval (a, b). These two 
values, if laid off on the Y-axis, give the limits of variation of f(a) in 
(a,b). Divide this interval into partial intervals by inserting the 
following points: 


Yo( = l), Yi, (Yast > UE 1h Uh ee 5 Yn(= L). 


We shall so select the intermediate points that for all values of k 


we have ge. 


where € is an arbitrarily chosen positive number. Let y;(2) 
(k = 1, 2,3,- - - 7) take the value one if x is such a value that 
yx < f(x) < Yeu and suppose Yx(x) to be zero for all other values of 
xin (a,b). Denote by W(x) (k = 1, 2,3, - - nm) a function which 
takes the value one if xz is contained in a set of points for which 
Yr1a< f(x) Sy. For all other values, suppose W;(x) to be zero. 


Put n n 
V(r) = Z yail(a), V(x) = 2 yWV,(2). 
b=0 k=0 


As W(x) and V;(a) take only the values one and zero, then from their 
definition it follows that, as n increases indefinitely in such a manner 
that € approaches zero, the functions W(x), W(x) approach uniformly 
the function f(x) as a limiting function. Upon integrating these 
functions, we have 


f V(x)dx sf f(x)dx s [ Viorde,a Sta, 
where the first and last integrals approach a common value as 
€ approaches zero. This common value is equal to the f : f(x)dax. 


However, from the discussion in the first part of this proof we know 
that the functions Y(x), V(x) are the derivatives of their indefinite 
integrals, except for a set of points at most of measure zero. Conse- 
quently, as €(> yz — yx—-1) approaches zero, the derivative numbers 
of $(x) are at least equal to f(z), except at a set of points of measure 
zero; for, in every interval the increment of the integral ip “f(x)dx 
is at least equal to that of f Y(x)dx. Likewise, the derivative num- 
bers of #(z) are at most equal to f(x), except for a set of points of 
measure zero; since the increment of the integral “f(a)dx is at 


most equal to that of ft W(2)dx in every interval. Hence, as n be- 
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comes infinite in such a manner that € approaches zero, the derivative 
of the indefinite integral (x) is equal to f(x) for all points of (a, b) 
with at most the exception of a set of points of measure zero. 

Finally, let us consider the case in which f(x) is any summable 
function. As in the previous discussions, it is sufficient to consider 
f(x) as positive or zero. 


Let fae) = f(z), if f(z) SN, 
= at F(t)! > 1s 
Put ,(x) = i “fala)de. 
We have then D+¢,(x) Ss Dt(z). 


Since f,(x) is bounded, it follows from the foregoing discussion that 


D*¢$,(x) re fn(X) 


for all values of n and for all values of z in (a, b) with the exception 
of at most a set of measure zero. Hence, for the same values of z, 


we have Dis) 27.0). 
As this relation holds for all values of n, we have 
Dto(z) 2 L fr(x) = f(a). 


However, as in the foregoing discussion, 


ie D+(a)dz < ji “Sade 


b 
or [cDo@)-S@)e s 0. 
As Dt¢(z) is never less than f(z), it follows that 
Dto(a) = f(2) 


for all values of x with at most a set of measure zero. A similar 
proof shows this relation to hold for the other derivative numbers, 
and hence the theorem follows. 


Cor. If f(x) is bounded and measurable in the interval (a, b), the 
indefinite integral 2 
o(2) = f “sean, 


has f(x) as a derivative at all points of (a,b) with the exception of at 
most a set of measure zero. 
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This corollary follows from the foregoing theorem because of the 
fact that every function f(x) which is bounded and measurable is also 
summable. 

If the given function has a bounded derivative, we have the fol- 
lowing theorem. 


TuHroreM V. Let F(x) be a function having a bounded derivative 
f(a), then the Lebesgue integral of f(x) exists and satisfies the relation 


J "Yada Fb) Fe): 


We have by hypothesis 
fla) -% = i, F(x + Az) ae Pac 


Azr—0 Az 5 

As we know, a derivative function, and hence f(x), is at most 
pointwise discontinuous and belongs to Baire’s class one. It has 
been shown in Art. 49 that every function of this class is a measurable 
function. The function f(x) is also bounded by hypothesis. It 
follows from the theorem of Art. 50 that f(x) is integrable in the 
Lebesgue sense. As the limit in (14) exists and is equal to f(a), its 
value could be obtained by taking the limit through any sequence 
of values of Ax dense at Ar = 0. Consequently, by Theorem VI, 
Art. 53, since F(x) is continuous and therefore summable, we have 


bR(e2 + Az) — FG b 
ale il ae a Cee f fede: (15) 


b+Az 
But since ie F(a + Axz)dz = f. n F(x)dz, 
a atOz 


we may write 
if “ERG Ac) een Ak ce Eaves i ” F(a)de 
- ie Pp q atAzr P 
=| F@)ae - ik (ade: 


Dividing by Az and passing to the limit as Ar approaches zero, we 
have by aid of the Law of the Mean 


L >[ F(x + Az) — F(x) dx 
Az30 Ja Az 


Therefore, we have the desired result, namely 


i {Glens EDEN 


xSb,asaz+Arsb. (14) 


= F(b) — F(a). 
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By comparing the foregoing theorem with the corresponding 
theorem for Riemann integrals, it will be seen that in the former 
case we made use of the condition that f(x) was integrable, while 
in the present case that restriction can be removed, provided f(z) is 
bounded. 


TuroreM VI. Let f(x) be a bounded, monotone function in the 
interval (a,b). Then f(x) has a finite derivative at every point of (a, b) 
with the exception of at most a set of points of measure zero. 


We shall consider the theorem for the case in which f(z) is a positive, 
non-decreasing function. A similar proof holds for other possible 
cases and is left to the reader to supply. 

The properties of the given function are preserved if we add Mz 
to it, where M is a positive, finite number. The derivative number 
D*F (a) of the function 


y = F(a) = f(z) + Mx 


is then never less than M. Moreover, the function F(x) may be con- 
tinuous or discontinuous, but it is not a constant throughout any 
subinterval of (a, b). 

The given function y = f(x) can have only ordinary discontinuities. 
If such a discontinuity occurs at xo, the inverse function 


r=(y) 


is defined as the value z, at all the corresponding values of y. Hence, 
the inverse function is continuous and has a bounded derivative num- 


ber D*w(y); for, this derivative number does not exceed + The de- 


rivative number D+y(y) may be zero for some values of y, since ¥(y) 
may be constant for certain subintervals. It can not be negative, 
however. It follows from Theorem III that W(y) must have a finite 
derivative at all points except at most a set of measure zero. To this 
set of y-points there corresponds a set of z-points also of measure 
zero. For, since the y-points in question form a set of measure zero, 
they may be inclosed in a set of intervals {I,} the sum of whose 
lengths is less than an arbitrarily small number 6. Let 6, be the 
length of the interval J,. In each of the intervals J, the derivative 
number D+y(y) is bounded, say less than A. This value A is also 


1 See W. H. Young, Quarterly Journal of Pure and Applied Math. (1910), 
Vol. 42, p. 79. 


318 LEBESGUE AND OTHER INTEGRALS [Cuar. VI 


equal to or greater than the least upper bound of the difference ratio. 
Then the values of x which correspond to the extreme values of y in 
I, must differ by less than 6,4. Consequently the set of x-points 
corresponding to those of y in {Z,} can be inclosed in a set of inter- 
vals the sum of whose lengths is less than A-6. But, as 6 is arbi- 
trarily small, the x-points in question form a set of measure zero. 

We have shown that ¥(y) has a finite derivative at all points with 
the exception of at most a set of measure zero. It now follows that 
F(x) has a finite or infinite derivative at all points of (a, 6) with at 
most an exception of a set of points of measure zero; namely the 
points corresponding to the y-points inclosed in the intervals {Jn}. 
However, the points where the derivative is infinite form a set of 
measure zero. For, if the derivative is infinite it is positively infinite. 
Suppose the measure of the set of points for which this is true is of 
measure greater than zero, say of measure N, where N > 0. Then 
the sum of the lengths of any set of non-overlapping intervals {I,’} 
inclosing these points must be at least equal to N. Because the de- 
rivative is infinite, the increment of the function over any of these 
intervals must exceed I,/-B, where B can be chosen arbitrarily large. 
Consequently the sum of the increments of the function F(z) in the 
intervals {J,/} exceeds N-B. As B is to be chosen arbitrarily large 
and WN is different from zero, N-B may be made arbitrarily large, 
which is impossible since F(x) is bounded. 

It follows then that F(x), and hence f(x), has a finite derivative 
at all points of (a, b) with at most the exception of a set of points of 
measure zero. 


TueoreM VII. Let f(x) be a continuous, monotone, non-decreasing 
function in (a, b). Then any of the derivative numbers Df(x) is sum- 
mable in (a, b), and we have 


He D f(x)dx < fb)-f(a). 


Put D f(z) = D f(z), where D f(z) Sn, 
=, where D f(x) > n. 


The derivative number D f,(x) is bounded and measurable. Hence, 


the indefinite integral 
ba(2) = ["D fala)az 


exists and has a derivative ¢$,(x) = Df,(x) at all points of (a, b) 
with the exception of at most a set H of measure zero. Inclose the 
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points # in a set of non-overlapping intervals {J} of measure = 
n 


Denote by J, that portion of the intervals {J} lying in the interval 
(a, x). 
Consider the function 
F(a) = f(x) + n-m(I2). 
On the set H, we have DEG) 27 
while on C(E£) we have 


Die) =D y= Die). 


Consequently, for an increasing x the increment of F(x) is equal to 
or greater than that of ¢,(x). For the interval (a, b), we then have 


b 
§(0) — f(a) +n-m {I} =f) ~ fla) +z FW) —~F@ z f Dfaleae. 
b a 
Therefore, the integral i D f,(x)dx is bounded for all values of n 
and hence must approach a finite limit as n becomes infinite. Denote 
by £, the points of (a, b) where D f(x) > n. We then have 
b 
i Dfn(z)dx > n-m(E,). 


b 
But since the integral ab D f,(x)dx approaches a finite limit as n in- 


creases indefinitely, it follows that L m(E,) must be zero. Hence, 
for all values of n, we have ies 


fa f(x)dx s['D fn(x)dx < f(b) — f(a) +. 


b 
As f(z) is monotone, non-decreasing and ih Df,(ax)dz is bounded, the 
first integral in the above inequality approaches a finite limit as n 


increases indefinitely. This limit is the integral AE Df(a)de. We 
therefore have 
[Di@ar = $0) - 1. 


TuroreM VIII. In the interval (a, b) let f(x) be a function of limited 
variation. Then f(x) has a finite derivative everywhere in (a, b) with 
the exception of at most a set of points of measure zero, and this derwa- 
tive is summable in (a, b).! 

By Theorem II, Art. 38, it follows that a function of limited varia- 
tion can be expressed as the difference of two bounded, monotone 


1 Cf. Lebesgue, Legons sur Vintégration, p. 128. The proof of Lebesgue, 
however, involves the condition that f(z) is continuous. 
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functions both of which are non-decreasing or non-increasing. As 
we have seen, any such function has a finite derivative at every point 
of the interval of definition with the possible exception of a set of 
points of measure zero. Moreover, this derivative is summable. 
The difference of two such functions would have the same property, 
and hence the foregoing theorem follows as a consequence. 


Cor. If f(x) is absolutely continuous in the interval (a, b), then a 
has a finite derivative at every point of (a, 6) with at most the exception 
of a set of points of measure zero. 


This corollary follows from the fact that every absolutely con- 
tinuous function is also of limited variation and hence the foregoing 
theorem applies. 


TurorEemM [X.! A necessary and sufficient condition that f’(x) 1s 
summable in the interval (a, b) and that 


10) - f(a) = [-s@az (16) 
is that f(x) is absolutely continuous in (a, 6). 


The given condition is necessary; for, assuming that f’(x) is sum- 
mable and that the relation (16) holds, it follows from Theorem I 


that | f’(2)dx defines an absolutely continuous function, and hence 


1) must be absolutely continuous. 

The condition of the theorem is also sufficient; that is, if we as- 
sume f(x) to be absolutely continuous, we can show that the relation 
given in (16) follows. From the absolute continuity of f(x) it follows 
that it is continuous and of limited variation, and hence by Theorem 
VIII it has a finite derivative f’(x) everywhere in (a, b) with the ex- 
ception of at most a set H of measure zero. Moreover, this derivative 
is summable. As H is of measure zero, the points of this set can be 
regarded as the inner points of an enumerable set of non-overlapping 
intervals {J,}, the sum of whose lengths is arbitrarily small. 


1 Lebesgue has established the following theorem, where the given function 
f(x) is continuous and f’(x) is replaced by a finite derivative number (See Lecons 
sur V'intégration, p. 122). 

TuerorEeM. Let f(r) be a continuous function and let one of its derivative 
numbers, say D*' f(x), be finite for all values of z in a given interval (a,b). Then 
a necessary and sufficient condition that D+ f(x) issummable in (a, b) is that f(x) 
is of limited variation. 
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We shall now define an auxiliary function f;(x) as follows. In the 
set C{J,} complementary to the set of intervals {J,}, let 


fi(z) = f(z), 
while in the set of intervals {I,,} where f’(x) is indeterminate or 
infinite let fi(x) take the values along a straight line joining points 
representing f(x) at the extremities of the interval. Then in the 
interval (a, 6), f/(x) is bounded, and hence by Theorem V we have 


filo) — fila) = H@ae. 


Since f,(x) and f(x) are identical on the set C(I,), as well as at the 
extremities of (a, b) and of any subinterval J,, we have 


f0)-f@=f. f@de+ 3 fp@d. a7 


Suppose the extremities of the subinterval J, to be Qn, Bn. Wemay 
then write 


(Bn 
1B fi@as = ik “Rl@)dz = f.(Bn) ~ fin) = f(Bx) ~ fe). 
Teen be noted Tat > {FBo) Enh 


is nothing else than the sum of the variation of f(x) in the intervals 
of the set {J,}. Because the function f(x) is absolutely continuous, it 
follows that this sum approaches zero with the measure of the set 
{I}; that is, with the sum of the lengths of these intervals. But 
as the sum of the lengths of the intervals {J,} approaches zero, the 
complementary set C{I,} becomes the interval (a, b) except for a 
set of measure zero. Since f’(z) is summable in the interval (a, b) 
and the value of the integral is not affected by the omission of a set. 
of points of measure zero, we have from (17) 


b 
10) - fla) = fs'@ae, 
which is the desired result. 

This theorem shows that a necessary and sufficient condition 
that a function f(z) may be the indefinite integral of a summable 
function is that f(x) shall be absolutely continuous in the interval of 
integration. The theorem holds if the derivative f’(x) is replaced 
by any derivative number, say D*f(z). 

For bounded functions, we have seen that whenever the Riemann 
integral exists, the Lebesgue integral must also exist, and the two 
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are equal. By aid of the foregoing theorem we are able to show that 
this is not necessarily true for non-bounded functions; that is, there 
are non-bounded functions which can be integrated in the Riemann 
sense, but which do not possess an integral in the Lebesgue sense. 


For example, consider the function obtained by differentiating the function 
Heo) =) pats 5 forz #0 
=O moe se Sip 
that is, the function age ; 
f'@) = af 2 sin 2~zo8 al xz ~ 0, where f’(0) = 0. 

As we have seen, f’(z) is a measurable function,! although it is not bounded in 
any interval including the origin. Moreover, f(x) is not absolutely continuous, 
since in every neighborhood of the origin the sum of the oscillations exceeds 
every finite bound,? however small a neighborhood may be chosen. Conse- 


quently, it follows from the foregoing theorem that f’(z) is not summable. It 
is, however, integrable in the Riemann sense. 


As we have seen, all bounded, measurable functions are summable. 
The foregoing illustration shows that this is not always the case for 
non-bounded functions; for, as pointed out, the function f(x) is 
measurable, although non-bounded and non-summable. 

One wishes to know the conditions under which the fundamental 
theorem of integral calculus holds for the Lebesgue integral; that is, 
the conditions under which a knowledge of the derivative (or a 
derivative number) of a function determines that function except as 
to an additive constant. From the foregoing discussions we are now 
able to say that a continuous function is determined except as to 
an additive constant if its derivative (or one of its derivative num- 
bers) is bounded for all values of x in the given interval (a, 6). As 
the foregoing illustration shows, this relation, however, no longer 
necessarily holds if the derivative (or derivative number) is not 
bounded in (a, 6). We can also say that the fundamental theorem 
of the integral calculus holds if we know the given function to be 
absolutely continuous, without placing any condition upon the de- 
rivative (or derivative number) other than its existence. 

It follows also as a consequence of Theorem I that every indefinite 
Lebesgue integral defines a continuous function of limited variation. 
The converse of this statement, however, is not true, although it is 
true that every continuous function of limited variation has a sum- 
mable derivative.® 


1 See Art. 49. 2 See Art. 38. 3 See foot-note on p. 320. 
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For the case of Lebesgue integrals. integration may be regarded 
as the inverse of differentiation for functions having a bounded 
derivative (or derivative number), but this relation does not necessa- 
rily hold if the derivative (derivative number) is not bounded, even 
though it may be finite in the given interval. 

55. Lebesgue integrals of functions of two independent variables. 
In Art. 50, we have seen how the Lebesgue double integral may be 
defined for a two-dimensional point set H. In case f(a, y) is measura- 
ble and bounded on the given set, it follows as for functions of a 
single variable that the Lebesgue double integral exists. The proof 
is similar to that for a function of a single variable. 

The notion of the Lebesgue double integrals may be extended to 
non-bounded functions of two or more variables in precisely the 
same manner as was done in Art. 53 for the case of integrals of a 
single variable. A very large number of the conclusions with refer- 
ence to the integrals of a single variable may be generalized to in- 
clude the integrals of functions of two variables, as the character of 
the proofs does not depend upon the number of variables involved. 

We shall consider the conditions under which a double Lebesgue \ 
integral may be made to depend upon iterated single integrals. To 
do this we shall make use of the Borel notion of measure. A set is 
said to be measurable (B) if it is formed from closed intervals or 
rectangles by addition and taking complements, repeated a finite 
or if necessary an enumerably infinite number of times. Conse- 
quently, the sum, difference, and product of sets which are measurable 
(B) are themselves measurable (B). Moreover, the limit of a se- 
quence of sets measurable (B) is also measurable (B) by virtue of 
this definition. It follows also that if a two-dimensional set is meas- 
urable (B), then on any straight line in the given domain the linear 
subset of E on this line is also measurable (B), a conclusion which 
is not always true for two-dimensional sets measurable in the Lebesgue 
sense. A function f(x, y) is measurable (B) in the region & if for all 
finite values of A the sets 


E(f 2 A), E(f < A), E(f > A), BY A) 


are measurable (B). We can also say that f(z, y) is measurable (B) 
on aset EZ if it is measurable (B) in a region R provided f (x, y) takes 
the value zero for all points of this region belonging to the comple- 
mentary set C(E£). 

In the discussion to follow, we shall make use of what is called 
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the characteristic function of a set. For example, $(z, y) is called 
a characteristic function of the two-dimensional set H if it takes the 
value one at all points of # and the value zero at the complementary 
set C(£). Such a function obeys certain laws. Thus if ¢ is the char- 
acteristic function of the set EZ, then 1 — @ is the characteristic 
function of C(E). Moreover, if ¢1, ¢2, . . . are the characteristic 
functions respectively of the sets E, #2, - - - , no two of which 
have points in common, then 


d’=hitgret+: 
is the characteristic function of the set H, where 
B= E,+ Be++ * 5 
and d = g1°d2- 
is the characteristic function of the product 
E = E,-E»- 
We have also the following theorem. 


TuroreM I. A characteristic function of a set EL, which is meas- 
urable (B), is a Baire function. 


By a Baire function is understood one which belongs to one of the 
Baire classes. As already pointed out, a set H is measurable (B) 
if it arises from the combination of closed intervals and rectangles or 
by taking the complements of such domains, including the passing 
to a limit if necessary. The characteristic function of the sets thus 
obtained by combining in a similar manner the characteristic func- 
tions of the individual sets gives the characteristic function of the 
resulting set. To establish the theorem, it is therefore sufficient to 
show that the characteristic function of any closed region is a Baire 
function. 

To do this, denote by d the distance of any point P from the given 
region R. Then d is a continuous function of P and takes the value 
zero whenever P lies in R. We may then define the characteristic 
function of R by the relation 


1 
= TG = © 
b= L oq where d, = 75 
As iene continuous in d, ¢ is a Baire function of class one, since 


it is the limit of a sequence of continuous functions and is not itself 
a continuous function. 
We shall now prove the following theorem. 
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TuHeorEM II. Any function which is measurable (B) is a Batre 
function. 


As may be readily seen, the limiting function of a sequence of 
functions each of which is measurable (B) is itself measurable (B). 
It is sufficient, therefore, to demonstrate the theorem for bounded 
functions, since every non-bounded function may be regarded as the 
limit as n becomes infinite of a sequence of functions each of which 
is the same function bounded by the condition that 


[f(y | <n. 

Let f(x, y) be bounded and measurable (B). Divide the interval 
between the least upper and the greatest lower bounds of f(x, y) into 
n intervals by taking on the Z-axis the points 

CRC cos Ck ACK 4-1, Poort at 
where they are so taken that ci: — c is less than €, ¢ being the 
greatest lower bound and c,,; the least upper bound of f(z, y). De- 
note by ¢ the characteristic function of the set EL S f(x, y) < ces}. 
By Theorem I each function ¢,¢; is a Baire function. Moreover, the 
given function f(x, y), which is the limit of the sequence of functions 
of the type {F,(z, y)}, where 


F(z, y) = 4, + ob, + - c - +60, + ° a = + Cnn, 


must also be a Baire function, as the theorem requires. 
We can now establish the following theorem. 


THEOREM III. Given the region R, defined by the inequalities 
ears, cays d. 
If f(x, y) ts bounded and measurable (B) in R, the double Lebesgue 


integral taken over R 1s equal to the iterated integrals taken over the same 
region; that 1s, 


ff fse nae, = fa [se naw. a 


The integrand f(z, y) is bounded by hypothesis. If it is also con- 
tinuous in (z, y) together, then the theorem holds; for, in this case 
the Riemann double integral exists and the order of integration may 
be interchanged. Consequently, the same is true for the Lebesgue 
integral. 

Let us now consider the more general case in which f(z, y) is 
bounded and measurable (B). By Theorem II, any function which 
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is measurable (B) belongs to one of Baire’s classes of functions. It is 
sufficient, therefore, to prove the theorem for the case in which f(z, y) 
is bounded and is one of Baire’s functions, say of class a. For this 
purpose we assume that f(z, y) is the limit of a sequence of functions 
{fn(z, y)} each of which is of class less than a@ but bounded simul- 
taneously as to n and (a, y) and measurable (B). As f, (a, y) is meas- 
urable (B) in R, it is also measurable (B) on an interval (c, d) on 
any line lying in R and parallel to the Y-axis. By the extension of 
Theorem VII of Art. 51 to functions of two variables, we have 


J [1 y)d(z,y)= Le f J pole y)d(a, y), 


[se nay = 2. file, vy 


If we assume that the integrals 


ff fee. nace w, Jo Soles Way 


exist for the functions f,(z, y) of class less than a@ and that the relation 
(1) holds for each f,,(@, y) we have from the foregoing relations 


f fre nae, = [rar tf" te vay 
= fia | ie, way, 


which holds where f(a, y) is of class a, as the theorem requires. 

Even if f(x, y) is non-bounded, it may be shown that the relation 
given in (1) holds, provided f(z, y) is non-negative and measurable 
(B). If we assume that f(a, y) is summable in the domain R, then 
the given theorem can be extended to non-bounded functions having 
either sign, since the given function can be written as the difference 
of two non-negative, summable functions.! 

In case the given function is measurable in the Lebesgue sense, 
but is not measurable (B), one may still show that the iterated inte- 


grals thee fi Gouna if F ie V2, y)dx 


both exist and have the value of the double Lebesgue integral taken 
over the domain R, provided this double integral exists. In reaching 


ll 


ll 


1 See Lebesgue, Annali di Mat., (3) Vol. VII (1902), pp. 274-282; also de la 
Vallée Poussin, Cour d’analyse infinitesimale, Vol. 2, 2d ed., pp. 117-122. 
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this conclusion one makes use of the fact that even though either 


of the integrals b a 
: ai I(x, y)dz, ie F(x, y)dy 


taken with respect to the one variable fails to exist for a set of values 
of measure zero of the remaining variable, the iterated integrals may 
still be said to exist.! It is to be noted, however, that the converse 
of this statement is not true; that is, there are functions Hes y) for 
which the two iterated integrals exist but for which the double 
Lebesgue integral over the given region does not exist. The exten- 
sion of the foregoing conclusion to non-bounded functions having 
either positive or negative values follows from the same considera- 
tions as in the previous case. 

56. Other definitions of integration. Aside from the definitions of 
integration already considered, there are various others to be found 
in the mathematical literature. Some of these definitions are gener- 
alizations of earlier definitions, while others introduce new concep- 
tions of integration.? 

Stieltjes and Hellinger have generalized the notion of integration 
in that the variable with respect to which the integration is taken is 
replaced by a function. 

Thus Stieltjes considers two functions f(x) and $(z) both of which 
are bounded. He then divides the given interval (a, 6) into n parts 
by inserting, as in the case of the Riemann integral, the intermediate 
points 
and sets up the sum 


U1, T2, U3, ° * *, Xn—1; 


2 f(&) [b(an) — (2-2); 


where & is any point interior to the interval (xz_1, x). If this sum 
approaches a definite limit as the maximum value of | x, — x,-; | ap- 
proaches zero, the Stieltjes integral is said to exist and is denoted by 


a ” t(e) db(2). 


If f(x) is continuous and @¢(z) is of limited variation the Stieltjes 
integral of f(x) with respect to ¢(x) can be shown to exist. It may 
be shown that every Stieltjes integral can be transformed into a 
1 See Fubini, Rend. del. R. Acc. d. Lincei, (5) Vol. 16 (1907), pp. 608-614. 
2 For a general discussion of the integrals related to the Lebesgue integral, 
see, Hildebrandt, Bull. Amer. Math. Soc., Vol. 24 (1917-18), pp. 113-144; pp. 
177-202. 
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Lebesgue integral of another function and conversely.’ By means 
of this relation to the Lebesgue integral, the Stieltjes integral may 
be extended to the case where f(z) is a discontinuous function.’ 

Hellinger’s definition of an integral is closely related to that of 
Stieltjes. He considers two functions f(x) and ¢(x), where f(z) is 
continuous in (a, 6) and ¢(x) is continuous and monotone increasing. 
Moreover, it is assumed that in any portion of (a, 6) where (2) is 
constant the function f(z) is also constant, and consequently if 
[o(x2) — (21)] is zero then [f (x2) — f (a)] is also zero. We now 
divide the interval (a, 6) into a finite number of intervals by means 
of the intermediate points 


2, Ta, °* * * » Gn—i, 


> L f(x) —f (tea) P 
ka1 (te) — &(te-) 


the quotient here expressed being defined to be zero whenever the 
denominator is zero. The least upper bound of this sum for all 
possible methods of subdivision of the given interval is called the 
Hellinger integral and is denoted by 


*Ldf(z)}*. 
a d(x) 

It has been shown that the Hellinger integral may be expressed 
in terms of a Lebesgue integral, and conversely every Lebesgue 
integral can be expressed in terms of a Hellinger integral.® 

Denjoy has given an important generalization of the Lebesgue 
integral. One can best indicate the nature of this integral by first 


and form the sum 


1 See Lebesgue, Comptes rendus, Vol. 150 (1910), pp. 86-88; also Van Vleck, 
Trans. Amer. Math. Soc., Vol. 18 (1917), pp. 326-330; Bliss, Bull. Amer. Math. 
Soc., Vol. 24 (1917), pp. 28-29. 

? See Lebesgue, Comptes rendus, Vol. 150 (1910), pp. 86-88; also W. H. Young, 
Proc. London Math. Soc. (2) Vol. 13 (1914), pp. 109-150; Radon, Sitzungs- 
berichte der Akademie der Wissenshaften, Wein, Ila, Vol. 121 (1912), pp. 265-297. 

® See Hahn, Monatshefte fiir Math. und Phys., Vol. 23 (1912), pp. 170-183. 
For an extension of the Hellinger integral, see Radon, Sitzungsberichte der Aka- 
demie der Wissenschaften, Wein, Ila, Vol. 122 (1913); pp. 1322-32. 

* See Comptes rendus, Vol. 154 (1914), pp. 859-62, and pp. 1075-78. See 
also Khintchine, Comptes rendus, Vol. 162 (1916), pp. 287-91; Denjoy, pp. 377- 
80, and Ann. Ecole Norm. (3), Vol. 34 (1917), pp. 181-238. Denjoy used the term 
totalizafton in connection with his theory of integration much as the term summa- 
bility is used in connection with the Lebesgue integral. 
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stating certain principles of construction which the author formulates. 
For the general form of the definition these principles may be stated 
as follows. 

1. In any subinterval (@, 8) of (a,b) in which the given meas- 
urable function f(x) is summable in the Lebesgue sense the Denjoy 
integral shall be identical with that of Lebesgue. The same shall 
also be true on any perfect sct. 

To distinguish the Denjoy integral from the Lebesgue integral in 
this discussion we shall denote them respectively by the symbols 


D yk ieee if Bitte 


2. If the integral D A rs f(x)dx is known for all values of a’ < 8’ 
i 


contained in (@, 8), then we shall have 
B B’ 
D if f(z)de = L Df” f(a)de. 
[e4 BB a 


3. If the Denjoy integral is known for a finite number of con- 
secutive intervals (a, Q2) (G2, @3) - - - (An_1, Qn), then we shall have 
the relation 


D “ s@dz =D {fade +D {fade + - Ay ete 


ay An-1 
4. Let E be a perfect set of points contained in a subinterval 
(a, B) of (a,b), and suppose that f(x) is summable on the set £. 
Let it be supposed that the Denjoy integral has been defined on every 
subinterval (a’, 8’) of (a, 8) which contains no points of H as inner 
points. Let (an, Bn), n=1, 2, 3- - - be the set of intervals comple- 
mentary to E with respect to (a, 8B). Denote by M, the upper limit 


B" : 
of | Df f(x)dz | for all intervals (@’, B’) in (dn, Bn). It is assumed 


that the series DM, converges. The Denjoy integral for (a, £) is 
then defined by the relation 


D af Sian =D ‘L: FOL Ab f(a)de. 


The Denjoy integral may then be said to exist for the interval 
(a, b) by the repeated application of the foregoing principles of con- 
struction, provided the given function f(x) satisfies the following 
conditions. 
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I. If £ is any perfect set contained in (a, b), the points of EB in 
whose neighborhood f(z) is not summable shall form a subset which 
in no portion of (a, 6) is everywhere dense with respect to E. A 
function is not summable in the neighborhood of a point, if there 
exists no subinterval containing the point on which the function is 
summable. j,, 

Pit lee f(x)dx, a’ < B’ is known for all values of a’, 6’ in 


B’ 
(a, 8), then f(x) must be such that the limit L D oft f(x)dx shall 


exist. BoB 
III. If Eis a perfect set in no subinterval everywhere dense and 


if D ion is known in those subintervals (@,, 6,) which are free 
from points of #, then f(x) shall be such ay the points of # in the 
neighborhood of which the series z D ‘lia f(x)dx does not converge 


absolutely shall not be everywhere date with respect to H in any 
subinterval. 

If f(z) satisfies these conditions, then by aid of the foregoing 
principles of construction the Denjoy integral can be calculated by 
means of an enumerably infinite set of Lebesgue integrals and passage 
to the limit. 

The Denjoy integral is more general than the Lebesgue integral, 
in the sense that there exist functions which have no Lebesgue 
integral which can be integrated by the method of Denjoy. Such 
an integral is, however, not absolutely convergent; that is, the 
Denjoy integral of the absolute value of the function does not exist. 
Moreover, for these integrals, we can say, as we did in case of Lebesgue 
integrals, that the indefinite integral of f(z) is continuous and has 
f(x) as a derivative with the exception of at most a set of points of 
measure zero. 

Perron! has introduced a notion of integration quite different 
from all of the foregoing definitions in that he has not based it on 
a summation process but has considered integration as the inverse 
operation of differentiation. By introducing what he designates 
as the adjoined upper and lower functions he is able to formulate 
a definition of integration which for bounded functions is identical 
with the Lebesgue integral, but for non-bounded functions leads to 


1 See Sttzwngsberichte der Heidelberg Akademie der Math. Wiss. (1914), Vol. 14, 
pp. 1-16. For other citations concerning the literature on the Perron integral, 
see Encyklop. der Math. Wiss. Vol, IIs, Part 7, pp. 1074-76, 
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a more general class of integrable functions than is the case with 
the Lebesgue integral. Under certain restrictions as to the con- 
tinuity of the adjoined upper and lower functions, the Perron integral 
for non-bounded functions becomes identical with that of Lebesgue. 
The Perron integral can be readily extended to functions of two or 
more variables. 

Bore! ' has given a generalized definition of integration which for 
bounded functions is more restricted in its applications than the 
Lebesgue integral, but for non-bounded functions can be applied 
to non-absolutely convergent integrals, which is not the case with 
the Lebesgue integrals. When, however, both the Borel and the 
Lebesgue integrals exist, they give the same value. 

Other modifications of the definitions of integration by Riemann 
and Lebesgue have been proposed by W. H. Young? and by Pier- 
pont.* For example, if we disregard the case where the upper and 
the lower integrals may become infinite, it follows that the Young in- 
tegral leads to the same class of integrable functions as the Lebesgue 
definition of integration. The Pierpont definition differs from that 
of Lebesgue in that the set of points over which the integral is taken 
is not necessarily a measurable set. 


EXERCISES 


a measurable function in the interval (1, — 1)? 


1. Is the function f(z) = : i 


a 

2. State the fundamental theorem of integral calculus. Compare the con- 
ditions under which it holds for Riemann integrals and for Lebesgue integrals. 

8. Given a function of limited variation. Is such a function integrable in 
the Riemann sense? in the Lebesgue sense? Could it have a finite derivative at 
the rational points and not at the irrational points? at the irrational points and 
not at the rational points? 

4. In the Lebesque theory of integration would any rational integral func- 
tion of integrable functions be itself an integrable function? 

5. Given f(z) = L f(z), where f,(x) is a point-wise discontinuous function. 

nc 


Under what conditions is f(z) summable? 
6. Show that every upper semi-continuous function is measurable and inte- 


grable. What statement can be made concerning the saltus function oL f(x) 1]? 


1 Comptes rendus, Vol. 150 (1910), pp. 375-377; also Encyklop. der Math, 
Wiss., Vol. IIs, Part 7, p. 1064. 

2 Philos. Trans. Vol. 204A (1905), pp. 221-252; Proceedings Royal Philos. 
Soc., Vol. 88A (1913), pp. 170-178, Proceedings London Math. Soc., Series 2, 


Vol. 13 (1914), pp. 109-150. 
3 Theory of Functions of Real Variables, Vol. I1 (1912), pp. 343 et seq. 
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7. Is every function which is continuous with respect to a set of points every- 
where dense an integrable function in the Lebesgue sense? Is such a function 


necessarily measurable? 1 2 1 
8. Show that the function $(#) = 2” sin ap ele is not summable. [See 


Art. 49; also Lebesgue, Lecons sur intégration, p. 115. ] 


. : sin? n!arax 
9. In Ex. 4, Art. 25, we considered the function f(xz)= L L —~——,- 
no to Sin?n!r2+t? 


Is this function bounded? measurable? integrable in the Riemann sense? in the 
Lebesgue sense? 

10. Let f(x) be defined as the limit of a sequence {f,(x)}, where f,(x) has 
only ordinary discontinuities. Is f(x) integrable in the Lebesgue sense? 

11. Let f(x) be any Baire function and define (x) by the relation 


(x) =) {(x)dz. Show that « = f(x) at all points, with the exception of at most 


a set of measure zero. i 

12. If f(z) is summable, show that the indefinite integral $(z) -f T(ax)dx 
can be expressed as the difference of two monotone functions. ‘i 

13. If f(z) is summable over the interval (a, b), show that it is summable 
over the set # consisting of those points of (a, b) which correspond to the algebraic 
numbers. Show that this integral is zero. 

14. Show that Theorem III, Art. 40, can be extended to Lebesgue integrals. 

15. Show that if f(z) is integrable in the Lebesgue sense on the set £, it is in- 
tegrable on any measurable subset of H. 

16. Define f(z) as equal to zero for all rational values of z and equal to 
= for all irrational values. Is f(x) measurable? Is it summable? 

17. Given a function f(z, y) which is continuous in each variable. Does the 
double Lebesgue integral exist? Do the two iterated integrals exist? 

18. Is every rational function measurable? Is it bounded? Is it integrable 
in the Lebesgue sense? ata 

19. Given the function f(z, y) = ae - for x ~ 0, y ¥0, where f(a, y) = 0, 


1 
for x =0,y=0. Does the double integral { F(a, y) d(x, y) exist? Do the 
1 1 1 We ELIE 
dxf Ge y)dy, f dyf f(x, y)dz exist, and if so, are they 
0 0 0 


iterated integrals { 
equal? ¥ 


CHAPTER VII 
INFINITE SERIES 


57. General definitions. Suppose we have given an infinite 
succession of positive or negative constants 


Uj, Us, Us, ° ° °°» Uny* ° *%y (a) 


whose order of succession follows some general law. The expression 
lee) 
2 Un = th + Ua t Se aa a ae oe 
ae 
where, as indicated, the summation is extended indefinitely, is called 
an infinite series, or more briefly a series. The numbers 


UU, U2, U3, . . . } Un, . . . 
are called the terms of the series. It is convenient to put 
Sn =U+U2et-s + + + Un. 


The series is said to converge if S, has a definite limit as n becomes 
infinite, that is if Teas 


no 


and A is called the sum of the series 2 wn, often written Zun. If 
n=1 
the limit does not exist, then the series is said to be divergent. 
A necessary condition for the convergence of a series > Un is that 
n=1 
Le th 0: 


for, otherwise the limit of S, could not be said to exist. This con- 
dition is not sufficient, however; for, the harmonic series 
je | 


1 1 
Pers eet ee et 


can be easily shown to be divergent, although it satisfies the above 


condition. . 
We should distinguish between a series and a sequence. An infinite 
sequence is merely a succession of terms following some general law 
333 
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in the order of succession. An infinite series is the limit of the sum of 
such a succession of terms. The two are related in that the limit or 
sum of a series is the limit of the sequence 


Si, So, S3, ° . > Pag * is 


as n becomes infinite. Hence, the laws of limits of sequences may be 
made to apply to the limits of series. 

Instead of the terms of the series being constants, they may be 
functions of one or more variables. Thus, if uv, is a function of z, 
we may have the series 


Dun(x) = u(x) + Ue(Z) ++ > + +Un(t) +> 


Such a series is said to converge for x = 2, if after having replaced 
x by 2, the series of constant terms Z u,(xo) is convergent. If the 
series converges for each value of x in an interval (a, b), we say 
that 2 u,(x) converges in this interval, which is called the interval of 
convergence if the given series converges for all values of x within the 
interval and diverges for all values exterior to it. The interval of 
convergence may be closed or not; that is, the question of conver- 
gence at the extreme points of the interval depends upon the nature 
of the given series. 

In the interval of convergence (a, 6), the series may be said to 
define a function, and we may write 


f(z) = L Sq(z) = , WEES 


The function f(x) is then defined for all values of x in the interval 
(a, b), which may be either open or closed. Thus, the series 
Ne oe BS eG pee ES 5 6 


converges for all values of x within the interval (— 1, 1) and we 


have — 1 
fay ae. a= ne 1S pel jester 


In this case, the series defines f(x) only for the open interval since 
the series does not converge for | x| = 1. 

If the terms of the series are functions of two variables, the con- 
vergent series defines likewise a function of two variables at each 
point of the region of convergence. 

In order to give a geometric interpretation to the convergence of 
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a series, let the codrdinates of a point in space be (a, ., wy). If the 


series 
u(x) + Use) ++ + > ture) +. =, 


converges for x = %, or what is the same thing, if the limit L S,,(20) 
exists, then for a given ¢€ there must exist ile 


BIN 


Fia. 41. 


n 
as indicated in Fig. 41, such that for all values of n > m, the cor- 
responding values of S,,(x») lie within this rectangle; that is, we have 


| f(to) — Sn(ao) |< € n> m. 


in the plane through zp parallel to the (v * plane a rectangle R, 


The sides of this rectangle are given by the equations 
n=o,n=m, y=f(%) + €. 


The terms of a series may not all be positive. The series formed 
by replacing each term by its absolute value is sometimes called the 
adjoint series. If the adjoint series converges, then the given series 
is said to converge absolutely. Thus the series 


ity ae eae 


tuo) ite 4 a 
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converges absolutely, since the series formed by taking each term 
positively, namely ie d : a ae Leen 
converges. 

If the series contains both positive and negative terms and con- 
verges, but not absolutely, it is said to be conditionally convergent. 
The following is such a series 

pe eh ea 
b=) eae 

A conditionally convergent series is characterized by the fact that 
the positive terms taken by themselves do not converge and like- 
wise the negative terms taken by themselves do not form a convergent 
series. For, if the series of positive terms and the series of nega- 
tive terms should both converge, then the given series must, by 
the law of limits, converge absolutely and to the algebraic sum 
of the limits of the two series. If either the series of positive terms 
or the series of negative terms fails to converge while the other con- 
verges, it follows that the given series can not converge. 

On the other hand, both the positive terms and the negative 
terms of a conditionally convergent series may form by themselves 
divergent series. In this case, it is possible, by a proper rearrange- 
ment of the terms, to make the given series converge to any arbi- 
trarily chosen number, or even to diverge. For example, consider 
a conditionally convergent series 2 un; and let 2 a, be the series of 
its positive terms and 2 b, the series of its negative terms. Since the 
given series 2 u, converges, it follows that the terms of the series 
2 Gn, & b, must have the property that 

TC Cpe OE Ti Otani 
O eC. Zs 2 
ay a,+a, 


Fia. 42 
Let C be any arbitrarily assigned number. It may be denoted by a 
point on astraight line. Denote by points on the line OX the numbers 
of the sequence di, +2, Qi +d2+43,: - -. (1) 
Since 2 a, is a divergent series some of these points must lie on the 


opposite side of C from the origin O. Let x; be the first such point, 
and let the corresponding term of the sequence (1) be 


4 +Q2+d3+° + > + ay. 
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To this result add a sufficient number of terms from the series of 
negative terms, 2 b,, so that we ultimately get a point ze lying 
between O and C. We then add terms from > a, (n > k) until we 
get a point lying again on the opposite side of C from O. Let 23 be 
the first such point obtained. We then add more terms from 2 b, 
and get again a point lying on the left of C. Continuing in this way 
we get a set of points dense at C because of the condition that the 
terms @,, 6, approach zero as n becomes infinite. Consequently, the 
series as thus arranged converges to the required value. 

Since we can always so arrange the terms of the foregoing series 
wu, in such a manner that the resulting series exceeds any given 
number A, however large this number may be chosen, it follows 
that by a proper arrangement of the terms of a conditionally con- 
vergent series 2 uv, we can form a divergent series. 

In the use of infinite series, it must not be assumed that the 
properties which hold for the sum of a finite number of terms may 
be extended without modification to an infinite series. Thus, the 
sum of a finite number of continuous functions is always a continu- 
ous function. The corresponding conclusion is not always true if 
the number of terms becomes infinite. Likewise, we can differentiate 
or integrate term by term the sum of a finite number of terms and 
thus obtain the derivative or the integral of the function represented 
by the sum, but it does not follow that we can do the same thing 
with an infinite series of terms even though the individual terms may 
be differentiated or integrated. In this chapter, we shall be interested 
particularly in discussing the conditions under which the processes 
of the calculus can be extended to infinite series. Many of these 
questions depend in the last analysis upon the interchange of the 
order of limits, that is upon whether the limit of the sum is the sum 
of the limits. The following illustration shows that this is not always 
the case. 


Consider the series where 


s(Gete) (beth) +--+) 


We have as the sum of the limits of the terms of the series 


1 
CAC ea Coa 
L 1 tany 
yaar ie 


sae carat Th 
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On the other hand, the limit LZ LS, does not exist; for, we have 


—>CO nN—>CO 
Wex = nik OED 
Li Dy (B53 ey als SE EI 
ka no k—>c ~n—0 |? 5-1 k 


= LL {1+ 0} =o, 


kc 


Consequently, the sequential limit taken in this order does not exist. 


58. Laws of operation with series. As we have seen, the laws 
of operation with a finite number of terms can not be assumed as 
holding when the number of terms becomes infinite. Even the proc- 
esses of arithmetic themselves must be defined anew for this ex- 
tended domain of operation. It will be seen, however, that with 
certain modifications and restrictions these processes can be so ex- 
tended. We shall now consider the conditions under which this 
may be done. 

One of the first questions to arise is as to whether one can always 
insert parentheses at pleasure in a series without affecting its con- 
vergence or changing its sum. This question is answered by the fol- 
lowing theorem. 


TueEorEM I. The terms of a convergent series can always be united 
into groups in any manner without affecting the sum of the series, pro- 
vided the order of the terms 1s not changed. 


Let S, be the sum of the first n terms of the given series and 
denote by Sj, the sum of the first m groups of terms. However 
large n may be, m may be taken sufficiently large so that Sj, will 
contain at least all of the terms of S,. If Sj, contains n + p terms 
of the given series 2 Un, we have 


Sin — Sn = Unti + Unge + ° r. * + Untp, p = 1, 2, : 


Denoting the second member of this equation by ,R., we have for 
any arbitrarily chosen ¢€ 
| Rn] <€, 


for ali values of n sufficiently large. As n becomes infinite, the 
value of m also increases without limit. The foregoing inequality 
is then equivalent to saying that 

iS, =ab oe 


no MoO 


Ny 
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This theorem shows that we can always insert parentheses at 
pleasure in a series. However, it is not always possible to remove 
them without affecting the sum of the series, as the following 
example shows. 


Ex. 4. Given the series 
ee 2 a3 3. 4 n nm +1 
spear NEY freee sees | Way (ee aap F sous == 

G 3) 3 4 G 5 sa (5 ae 


jodie bee 1 
a eT 2g, SE, hg ee ee RD ee i 
ie oer ae PEG) | 


This series is convergent, since its terms are less than the corresponding terms 
: : i 

of the convergent series ne In fact, the series converges to — 5° If we remove 
the parentheses in the given series, we have the oscillating series 


12) eg oe 4 


eet ay ca haar ent? ee 


which can not have a unique sum, since the limit L S, now depends upon 
whether n is even or odd. ates 


The following theorem gives a sufficient condition for the removal 
of parentheses. 


TuroreM II. If a series involving parentheses converges absolutely 
after the parentheses have been removed, then the removal of the paren- 
theses does not affect the sum of the series. 


Denote by Si, the sum of the first m terms of the given series, 
where the content of each parenthesis is taken as one term, and let 
S, denote the sum of the first terms after the parentheses have 
been removed. The value of m may certainly be taken sufficiently 
large to contain at least the n terms of S,. It follows that 


| 8% — Sa] S| um | +] uae] +> > + +l nse, 


where n + p denotes the number of terms of the series which are 
included in the first m parentheses. From the absolute convergence 
of the series after the parentheses have been removed, we know that 
the right-hand member of this inequality may be made as small as 
we please by taking n sufficiently large, say n > n’. We have then 
for an arbitrarily small e, remembering that as 7 increases indefinitely 


m does also, se = Be <én>n,m>n’, 


whence DAS, = Ie aSe- 


m—o no 
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TuroreM III. In an absolutely convergent series, the terms may be 
rearranged at pleasure without changing the sum of the serves. 


First of all, let us assume that all of the terms of the given series 


are positive. Put 
P Sa=Utwet- > + + Un, 


and let L 8,=A. 


no 


Denote by S/, the sum of the first m terms of the rearranged series. 
As all of the terms are positive S/, is a monotone increasing function 
of m. Having selected the value of m, the value of n can be taken 
large enough so that all of the terms of S;, are included in S,. Hence, 


we have Se Zug eal 


Consequently, S;, is not only a monotone increasing function of m, 
but it is bounded; and it follows that S;, must have a definite limit 
as m becomes infinite. We may therefore write 

DH Sh = BS A, 

m— co 
If we now regard the given series 2 u, as a rearrangement of the 

series 2 uj, we get, in a manner similar to that employed above, 

L ise a A < ‘Be 


NO 


Consequently, it follows that A and B must be equal and hence 
Ls Set Bel Soe 


nc mo 

Let us now suppose that the given series contains negative terms 
but that it converges absolutely. Let 2 a, be the series of positive 
terms and 2 b, the series of negative terms. Denote by S,(a) the 
sum of the first m positive terms and by S,(6) the sum of the first p 
negative terms of the given series. Moreover, let us so select m and 
p that 
n=m+p. 


We have then 5, = Seo. 


As m and p become infinite, it follows that n also becomes infinite. 
As the given series converges absolutely, it follows that the two 
series 2 an, 2 b, converge. We may then write 


L: Sq(a)= Mee Oe 
m— co pa 
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whence, noting that 


L Sx= L Sala) — L S,(b), 
no m— oo po 
it follows that A=M-P. 
Denote the rearranged series by 
Ui tug ts + + +m + 


The series of positive terms and likewise the series of negative terms 
in Du,” must converge by virtue of the foregoing discussion. It fol- 
lows that Dw,’ must also converge. If we denote the three sums by 
M’, P’, A’, respectively, we have 


A’ = M’' - P’. 
It still remains to show that A and A’ are equal. However, by the 
first part of this discussion, it follows that 

Mea MM; P= PB: 
Hence, we have A’ = <A; 
that is, the theorem is established for the case of absolutely con- 
vergent series as well as for series containing only positive terms. 

To rearrange the terms of an infinite series is equivalent to ex- 

tending of the commutative law of addition to the sum of an infinite 
number of terms. The foregoing theorem gives the condition under 
which that may be done. 


Ex. 5. Find the sum of the series 
ah CU een Cae sik fe a Lee | ih Al 
sta mtatm— at ato mat: 

This series converges absolutely; hence, by the foregoing theorem, the terms 
can be arranged in any convenient order without affecting the sum. We may , 
then write the series as follows. 

tela ee Lee eer I 


a7 mtg gt oe” OT oF 

ieee Ol la ie eT 

—5))-atm- ot pt 

1 re. ne Se teat) 
{Cte et) Gtatat 

1 


pe tld at hl $- 3) <5 
ee EE en OE Ie oe 9 


We shall frequently need to combine series and hence we must 
define such operations as addition, subtraction, multiplication, etc., 
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when applied to infinite series. If we have given two series } t,, 2 v, 
we shall understand by the sum of these series that series formed 
by adding the corresponding terms of the two series; that is, 


D Un + D Mn = D(Un + Vn) 
(ur + 01) + (Ue + v2) $+ + + + (Ua + a) + - 


That the commutative law of addition holds for the sum of two 
series follows at once from the foregoing definition; that is, 


I] 


D Un + 2 Wn = 2m + Z Une 
A corresponding definition can be formulated for subtraction; 
namely, 
D Un — 2 Vn = 2 (Un — Va) 
= (ur — m1) + (Ue — 02) +> + + + (Cn — On) + 
In the multiplication of one polynomial by another, we multiply 


each term of the one by every term of the other and take the sum of 
the products formed. For example, if we put 


Sp =U +Uet-: + ++, 
T,=%) +g ++ > ++, 
the product of the two polynomials may be written 
SaTn = Uti + U2 + Us ++ + + + Uwe (3) 
+ Usl1 + UgVe + Us + +> > + + Uva 
+ Usdi + Usde + Usds +> + > + Uda 


+ Uad1 + Uads + Ugds +> + > + Usda 


+ Und1 + Unde + Uns + > > > + Unda. 
If n is allowed to become infinite, we are led to the product of two 
infinite series. It is convenient to exhibit such a product by grouping 
the terms of the above array by diagonals. We shall understand 
the product of the series } u,, Y v, to mean the series 


DZ (Und1 + Une + + + + + Uda + Ua) = UW + (Ur + Ue) 
+(usditUvetuUds) + + + + H(UntibUpadet > > + +wr)+ > ++. (#& 


The question is then under what conditions does this series converge 
to the product AB; that is, under what conditions do we have 


£E Sa:T. =. L S,- L T, = AB. 


no n—-0 n—-c 


ee 
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It can be shown that if this product series converges at all, it 
converges to the limit A-B.! The difficulty is that it does not 
always converge as the following example shows. 


Ex. 6. Consider the product of the series 2(— 1)"7 nA by itself. 
The given series - 
1 1 1 1 
UA OS) Dc 2 See BR: a es ee 
Sie Va ES VE 
converges, since the terms are alternately positive and negative and the condition 
for the convergence of such a series exists; namely, 


Lb wm= L aay 


nao no nh 


However, the product of this series by itself gives the series 


ee) Ga 


1 1 1 1 1 ) 
+ ( — + ————— + ———__ + - - -4+ = + -=) F -: 
(% V2n—-1) V3(n — 2) V2(n—-1) Vn ‘ 
which is a divergent series. In fact, since 


)2 


k(n-k+1)=4(n+ 1)?- {5+ I)- ky Sgt, 


1 
4 
we have 


1 2 
Ou fe 


5 (n+1) 1+ 


1 1 1 1 1 
a +— 
Fa ‘4 VUn-1) V3a(n — 2) V2n—-1) Vn 


i 
Nn 
As all the terms of the product series are equal to or greater than 1, it follows 
that the series is divergent. 

The following theorem due to Mertens? gives a useful criterion 
for the multiplication of series. 

TureoreM IV. Let the series D un, Z v, converge to the limits A, B, 
respectively. If one of these series converges absolutely, then 

A+B = 2 tq" On = Z Dn, 

where Dn = Un + Un + Un2+ °° + + Unt 


1 See Abel, Crelle’s Journal, Vol. 1 (1827). The older mathematicians assumed 
that the product of two infinite series follows the rule for the multiplication of two 
polynomials without any conditions as to convergence. T hus De Moivre (1697) 
extended the binomial theorem to infinite series without raising the question of 
convergence. The first to call attention to the necessity of considering the con- 
vergence of the series was Cauchy, who showed that two absolutely convergent 
series may be multiplied according to the method suggested and that the resulting 
series is absolutely convergent. 

2 See Crelle’s Journal (1875) Vol. 79, p. 182. 
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Let us assume that 2 v, converges absolutely, and denote by Pr 
the sum of those terms u,-v. of the product such that 


r+ssn+]1; 
that is, Pa=Pitpot:*:*+Dn- 
Hence, we have 
Py=(uy + Ut + + + $Un) (dr + 02+ + + + +Un)—V2Un—03(Un + Uni) 
—+ + + = n(UetUs+- + > +4). (6) 
Let Sn =U +uUet: + + +Uny 
Ty =e 0a One 


Subtracting AB from both members of (5), we have upon taking the 
absolute value 


|P, — AB|S|S,-T, — AB| + |vel [unl + |vs | [n—1 + Un| + Sie tad 


+m] |ue+ust+- + + +Un|. (6) 
Let k be some integer between 1 and n, say 5 if n is even and ~ 5 : 
if n is odd. Denote by 6 the largest of the positive numbers 

bitin |, | digs et) = ~ 24 | ie oe eae 
and by y the largest of the numbers 
| the sec 2b teter [pots © Oe jullithe Slettaet eta eae 
We then have from (6) 
|P, — AB] = |S.T, — AB] + 6{| ve | + [vel + - - + + [resal} 
+ Y | lees) es Oem 

As n increases indefinitely, 6 and {|vz4s| + - - - + |vn|} decrease and 
each approaches the value zero, while y and {|v2| + - - + + |veyel} 


remain finite. Consequently, as n becomes infinite each term in the 
right-hand member of (7) has the limiting value zero. Hence, we 
have ie 
as was to be shown. one 

Since the series 2 wu, and Dv, may be multiplied when either of 
them is absolutely convergent, it follows, of course, that the same 
is true when both converge absolutely. In the latter case, one may 
rearrange the terms in any order at pleasure, and we may take the 
product by grouping together, as we have done, the terms in the 
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successive diagonals of (8), or by taking them in any other order at 
pleasure which enables us to include in the result all the terms of the 
product. 


Ex. 7. Find the product of the two series 


i ree Gee! 
ie alta 

leet, iter 
Mela ge 


Both series converge, the first to the value e and the second to the value log 2. 
The first converges absolutely and the second conditionally. However, by the 
foregoing theorem the product of the two series must converge to the limiting 
value of e log 2. 


It may be shown that the product of two conditionally convergent 
series will not always be an absolutely convergent series, although, as 
Abel’s investigation already quoted shows, two such series may be 
multiplied by the foregoing method provided the resulting series con- 
verges. However, a conditionally convergent series or even a diver- 
gent series multiplied by a conditionally convergent series will under 
certain conditions give a product that is absolutely convergent.’ 

59. Uniform convergence of a series. Suppose we have given a 
series of functions 


D un(x) = w(x) + w(x) + - > + un(x) + ° pabeae9 


which converges for each value of x in a given interval (a, 6). In 
this interval the series defines a function of z and we may write 


f(z) = 2 unl). 
Not all of the functional properties of the individual terms Un(2) 
are necessarily valid for the function f(z) defined by the series. For 


example, each u,(z) may be continuous without f(x) being continu- 
ous. As an illustration, we have the following example. 


1 See Pringsheim, Math. Ann., Vol. 21 (1882), pp. 327-378; also Trans. Amer. 
Math. Soc., Vol. 2 (1901), pp. 404-412. He also sets up a sufficient condition 
under which two conditionally convergent series may be multiplied if the terms 
of one of the series can be arranged in groups each containing a finite number of 
terms so that this series of groups converges absolutely. Voss has developed a 
necessary and sufficient condition for the multiplication of two such series where 
there are but two terms in each group. [See Math. Ann., Vol. 24 (1884), pp. 
42-47.] Cajori has extended the results of Voss to the case where the number 
of terms in each group is variable [see Bulletin of the Amer. Math. Soc., 24 series, 
Vol. 1 (1895), p. 180; Vol. IX (1903), p. 188; Trans. Amer. Math. Soc., Vol. 2 
(1901), pp. 25-36]. 
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Ex. 1. Given the series for which S,(x) = cae where -1S 21. Test the 
limiting function f(z) for points of discontinuity. 
For all finite values of n, S,(z) is a continuous function of z. However, 
f(z) = L Sn) 
nao 


is not continuous at += 0; for, we have 


fc for 0: 
=) OF Morr 20; 
= Es, tore 10: 


Likewise, it can not be assumed that because each term of a 
series can be integrated the sum of the integrals thus formed is the 
integral of the function defined by the series, even though the series 
of integrals converges. A similar statement can be made with refer- 
ence to the differentiation of a series term by term. Evidently, 
then, one must know more about a series than the mere fact that it 
converges in order to answer some of the more fundamental ques- 
tions about the operations upon it by the ordinary processes of the 
calculus. A sufficient condition for many of these operations is given 
by what is known as the uniform convergence of the series. 

When we say that a series 2 wn(x) converges for all values of x 
in an interval (a, b) we mean that for each value of x, say 2, in that 
interval the series of constant values 2 w,(2o) is convergent; that is, 


we have ih Sn(Xo) -Az= f (ao). 


Written as an inequality, this relation means that for a previously 
assigned, arbitrarily small, positive value €, we have for all values of 
mn greater than some integer m 


| Sn(wo) — f (@o) | < €, n > m. (1) 


The value of m depends both upon the value assigned to € and the 
choice of the particular value of x. For any given e, the value of 
m is a function of x, and to each value of z in the given interval 
there corresponds a definite value of m. The aggregate of all these 
values of m as x takes all values in (a, b), may have a finite upper 
bound. If this is the case, we say that the given series converges 
uniformly in the interval (a, 6); otherwise, the convergence is said 
to be non-uniform.’ In the case of uniform convergence, it is then 

1 The notion of the uniform convergence of an infinite series was first developed 
by Seidel (1848) in a paper published in Abh. Akad. Miinchen, Vol. 5, pp. 379-393, 


and by Stokes (1849) in a paper published in the Trans. Cambridge Philos. 
Society, Vol. 8;, pp. 583-583. 
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possible for an arbitrarily chosen value of € to select a value of 
m > 0 which does not depend upon z and yet satisfies the conditions 
imposed upon it by (1); that is, for a given € it is possible to so 
choose the value of m that it answers uniformly for all values of x 
in the interval (a, b). 

As we have seen (Fig. 40), ordinary convergence of a series means 
geometrically that for a given € and a given value of 2, the values of 


= S,(a), n > m(2o) 
lie within a particular rectangle situated in a plane through the line 
x = 2 and parallel to the coérdinate plane (;. y ) Uniform conver: 


gence means that for a given value of € all of these rectangles may be 
taken to be the same size whatever value of x may be selected. The 
curves representing 


Ge S,(2) 


are known as the approxi- 
mation curves. Denoting 
the upper bound of m/(a) 
by mu, it follows in the case 
of uniform convergence that 
the approximation curves 
for n > m, all project into 
curves in the (XY)-plane 
which lie within a strip Fria. 43. 
bounded by the curves 


y=f@) +6 


as indicated in Fig. 43. Instead of considering the curves y = S,(2) 
in three-dimensional space, it is often more convenient to consider 
only the projections of these curves upon the (X Y)-plane. If this 
is done, the representation reduces to two dimensions as illustrated 
by the following example. 


Ex. 2. Draw the approximation curves and show the uniform convergence of 
the series 


cle hometa unos 


2 ob gon 
n 


Cap ae ee gcd a | yest 
z—->+ + ( ae wremsea| 


This series converges in the interval (0, 1) and defines the function 


y = arc tan z. 
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Several of the approximation curves 


y = Si(x) = 2, 2 
y = S:(z) = 2-3) 

5 ee iS, 102 
y= S(t) =2- 3+ 5 


are shown in Fig. 44. It will be observed that any two consecutive approxima- 
tion curves lie on opposite sides of the curve y = f(x), and moreover each les 
closer to this curve than any of the pre- 
ceding. For n sufficiently large, all of the 
approximation curves lie wholly within 
the € strip indicated. Consequently, the 
given series converges uniformly in the 
interval (0, 1). 

Ex. 8. Draw the approximation curves 
and show the non-uniform convergence of 
the series for which 


The series converges for all values of x 
in the given interval; for, we have 


O o=l 
Fig. 44. f@)= LG S@)= 2B 


no noo 1+ nsx? 


nex 


The function f(x) is then represented by a segment of the X-axis. Two of the 
approximation curves are shown in 
Fig. 45. Y 
It will be observed that the ap- 
proximation curves in this case 
have a peak which grows higher 
and sharper as m increases. It is 
evident that these curves can never 
lie wholly within the ¢ strip, how- 
ever large m may be chosen; for, 
the peak always extends beyond 
this strip. The peak, however, is 
situated closer and closer to the 
origin as ” increases, and, should 
we exclude an arbitrarily small 
interval including the origin, the 
value of m can be taken so large 
that the peak would, from that 
point on, always lie within this Fia. 45. 
small interval. Consequently, while 
the given series does not converge uniformly in the interval (0, 1), it does eon- 
verge uniformly in any interval (7, 1) where 7 is positive and as small as we 
please to make it. 
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Thus far we have considered the uniform convergence of an in- 
finite series with respect to an interval. One may generalize this 
notion and discuss uniform convergence with respect to a set of 
points. 

One may likewise consider the uniform convergence of a series 
at a single point. If we have given the relation 

diehat).— 0; 


ane 
or what is the same thing, the relation 
L Sn(x) = f(ao), 
ABE 

then the point x = zo is sometimes spoken of as a point of uniform 
convergence of the given series. 

The following theorem gives us a convenient test for uniform 
convergence, known as the Weierstrass test. 


TuroreM I. A given series Z un»(x) will converge uniformly in the 
interval (a, b) if the series 2 M,, of positive terms, where Ca Ue 
for all values of x in (a, b), 1s convergent. 

Put R(x) = Un(Z) + Un4i(x) + > 
We have from the given hypothesis 

| R,(2) | = M, + Mass ae 0 


But as the series 2 M, converges, the right-hand member of this 
inequality can be made less than any arbitrarily small value € by 
taking n sufficiently large, say n > m. We have then 


| Ra(z) | = | Saxe) - f(a) | < ¢, 
for all values of z in (a, b) and for n > m, where m is independent of 
z. This is nothing else than definition of uniform convergence. 
Ex. 4. Test for uniform convergence the series 


Shoe, MoT |, ee 
3 ie 
Forming the series of greatest numerical values of the terms of the given 
series, we have for all values of z in question 


4 teeth 
EM.-Z\itat Rt +} 


= |i 
— {sin z— 
T 
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This latter series is convergent, since its terms are less than the corresponding terms 
2 1 ; ; 
of the known convergent series 2 oat Hence, 2M, converges and the given series 


converges uniformly. Some of the approximation curves are shown in Fig. 46. 


Fic. 46 


It will be observed that S,(z) is in reality a function of the two 
independent variables x and n. Consequently, those properties 
already developed in Art. 26 with reference to the uniform conver- 
gence of a function f(x, y) to the limiting function f(z, yo) apply 
directly to the uniform convergence of an infinite series. For ex- 
ample, if the terms u,(x) are continuous functions of x, then S,() 
is continuous and we have from Theorem VII of Art. 26 the following 
theorem. 


THEOREM II. Given the series 2 un(x), where Un(x) are continuous 
functions of x. A necessary and sufficient condition that D un(x) con- 
verges uniformly in the interval (a,b) is that the simultaneous limit 

L S8,(«) exists for each point xo in the closed interval (a, b). 


mi—X0 
no 


ne 


Ex. 5. Given the series the sum of whose first n terms is S,(x) = ————- 
1 + nz? 


Show that it converges non-uniformly in the interval0 < x < 1. 

For all finite values of n, S,(x) is a continuous function of z in the given interval. 
The series converges for all values of x in the given interval, for if xo is any value 
of x in this interval, we have 


Ty, Sp (t0) a) ola ee Oe 
n—0 gee: n— 0 1+nix? 
However, the simultaneous limit : 
na 


oy = gens 
no nro 
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does not exist. For, if we let n become infinite and then allow z to approach 
zero we have the limiting value zero, while along the path z = + we obtain the 


limiting value 3. Since the simultaneous limit does not exist at one point of the 
closed interval (0,1), then by the foregoing theorem the convergence is non- 
uniform in the given interval. If any interval inclosing the origin is omitted; for 
example, if we consider the interval (€, 1), where € > 0, the series is uniformly 
convergent in that interval. 


It follows from the foregoing theorem that if a series converges 
uniformly, one may interchange the order of the limits L  L for 


nO XX 


any 2 in the interval-of uniform convergence. Thus we may write 
PAGE ADs) = Ls LOS), 


Ir no NO 22 
Theorem VIII of Art. 26, stated for the special case of an infinite 
series, gives the following theorem. 


TueorEM III. Jf S,(x) has a derivative S,(x) for all finite values 
of n and for all values of x in the closed interval (a, b), and if for all 
such values of x and n, we have 


| S.(@z) | < M, 
where M is a finite number independent of x, then the given series con- 
verges uniformly in (a, b). 


Ex. 6. Test for uniform convergence the series 


1 
1+ete7tete ee 4+ arte ss, |e] <5: 
1-2 
We have S,(@) = 75’ 


whence for all values of x in the given interval and for all values of n sufficiently 
large we have 1— nz" + (n— 1)2" 


(1 — =)? 


Consequently, in the interval (—4, 4) the given series converges uniformly. 


< 4. 


Sn (2) 


From the discussion of the properties of the limiting function in 
the case of two variables (Theorem XI, Art. 28), it will be seen that 
for the special case of infinite series we may state the following 
theorem. 


TuroreM IV. Let the series D un(x) converge in the interval (a, b) 
and suppose u,(x) to be a continuous function of x in this interval for 
all values of n. Then the points of uniform convergence of 2D Un(&) 
form a set which is everywhere dense in (a, b) and has the cardinal 
number of the continuum. 
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Some of the consequences of uniform convergence follow as special 
applications of the results of the discussion in Art. 26 of the uniform 
convergence of a function f(z, y) to the limiting function f(x, yo). 
For example, from Theorem IX, we have the following theorem. 


TureoremM V. If the terms of an infinite series are continuous 
functions of x in a given interval (a, b) and the series converges uni- 
formly in this interval, then the function defined by the series 1s also 
continuous in the same interval. 


It may also be shown that every continuous function may be 
represented by a series of polynomials. Indeed, if the interval is 
closed, it may be shown that this series of polynomials converges 
uniformly and absolutely. 

The condition set forth in the foregoing theorem is a sufficient 
rather than a necessary one. The following example furnishes an 
illustration. 


Ex. 7. Given the series 2 un, for which 


NL 


1+ nx’ “ 


S,(x) = 0 ss zx 


IIA 


Test the uniform convergence of the series and the continuity of the function 
defined by it. 


In the given interval S,(x) is continuous, but the limit LZ S,(x) does not 
no 
z—0 


exist. Hence, by Theorem II the series does not converge uniformly, a fact 
which may also be seen from the approximation curves, which are the same as 
those given in Fig. 22. However, the series defines the function 


fe)= L— 


eo ee 


and hence is continuous in the given interval. 


If we assume merely that the given series of continuous functions 
converges, it then follows from Theorem IV that the points of uniform 
convergence are at least everywhere dense in the given interval and 
form a set having the cardinal number of the continuum. Since the 
limit L S,(x) exists for each x in the interval of convergence, it fol- 


no 


lows from Theorem V, Art. 24 that at the points of uniform con- 


1 Due to Weierstrass, Berliner Sitzungsberichte (1885); see also Borel’s Lecons 
sur les fonctions de variables reelles, Chapters IV, V, for discussion of various 
proofs and citation of literature. 
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vergence, that is where L S,(x) exists, the limit L L S,(x) also 


N—> CO LZ—-% n—-0o 
IX 


exists and is equal to f(x). In other words, we have 
L f(x) = f(a). 
zr— IX 


Consequently, at these points the limiting function f(x) is continu- 
ous and we have the following theorem. 


TuroreM VI. [f the series X un(x) converges in the interval (a, b) 
and if each un(x) is continuous, then the limiting function f(x) 1s at 
most pointwise discontinuous. Moreover, the points of continuity form 
a set having the cardinal number of the continuum. 


It must not be assumed that because the terms of a series are 
discontinuous it can not converge uniformly. The following is such 
a series and defines a function known as the Riemann function.! 


Ex. 8. Denote by (x) the positive or negative excess of x over the nearest 
larger or smaller integer. If z is midway between two integers, let (x) be zero. 
In any finite interval, test the uniform convergence of the series 

(nt) (x) , (2x) | (82) (nx) 
gia wel 2? an © tet E 

It will be seen that + is the least upper bound of (nz). Hence, the Weierstrass 

test for uniform convergence applies; for, the series of greatest numerical values of 


Pt: core : : 1 

the individual terms is less term by term than the convergent series 2 maa Each 
term of the series is discontinuous. For example, the first term is discontinuous 
at the points a aes eee 
The second term is discontinuous at the points 

De See Se 

4) 4) 4) 
All the points of discontinuity of the various terms are points of discontinuity 
of f(z). In fact, every value of x = oa where p is prime to 2m, is a point of dis- 


continuity of f(z). The totality of these points forms a set of content zero. 


60. Simply-uniform convergence. Quasi-uniform convergence. 
From the discussions in the previous article, it is evident that while 
ordinary uniform convergence gives a sufficient condition for the 
application of some of the fundamental operations of the calculus 
to infinite series, a more restrictive condition is desirable. For this 
purpose Dini? introduced what he called simply-uniform conver- 


1 See Gesammelte Werke, p. 228. 
2 See Fundamenti per la teorica delle funziont di variabili reali (1878), p. 103, 
or German Ed., Griindlagen fur eine Theorie der Functionen, p. 137. 
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gence. A series  un(x) defining the function f(z) is said to converge 
simply-uniformly if for each integer m however large there exists at 
least one value of n greater than m for which we have 


| Ra(z) | = | Sax) -f@) 1 <6 (1) 


for all values of z in an interval (a, 6). 
For example, suppose we have given a series whose terms are 
formed in accordance with the law! 


x —2 
Wend ng? + (1 — na)?’ ee (n+)e?+f1—-(n+ Daf’ 
where n = 1, 2,3, - - -. We have then the series 
a x x 


4 -s)? + Ud—2s)? I+ —20)* 
This series converges for all values of z in the interval -1 << 231 
and defines the function 


f(z) = 


ee enon aa), 
x? + (1-2)? 
For an odd number of terms, we have 

| Sena(z) — f(z) | = 0, 


and hence the inequality (1) is satisfied for those values of n, and 
the series converges simply-uniformly. For an even number of terms, 


we have is 


| Ron(x) | = | Sen(x) — f(x) | = oa (Loan 
In order that the given series shall converge uniformly in the ordinary 
sense, we must have 

| R.(z) | <«, 


for all values of n greater than some value m independent of x and 
for all values of x in the interval in question. That this is not true, 
if n is an even integer, may be shown by taking the limit along the 


line 


by which we have 


1See Tannery, Théorie des fonctions, p. 134. 
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While the series can not therefore converge uniformly in the ordinary 
sense, it does converge simply-uniformly as we have seen. It follows 
at once from the foregoing definition that every series which con- 
verges uniformly must also converge simply-uniformly, although the 
converse is not necessarily true. 

It is to be noted, however, that by the proper grouping of the 
terms of a simply-uniform convergent series one may always form a 
new series which converges uniformly. For, let the given simply- 
uniform convergent series be 


U(x) + Us(x) + s(x) + > + - + Un(e) +- 


Since it converges simply-uniformly, there must exist a sequence of 
integral values {n;} dense at infinity, such that for each value of 
nm, greater than some integer m, we have for all values of x in the 


given interval (a, b) 
| S.,(@@) -f@)|<-e, 


where € is arbitrarily small. However, S,,(v) may be written in the 
form 


Sn,(2) = Sp,(z) + {8_,(2) —Sa,(z)} ++ + - 
+ {Sa,(2) — Sa}. @) 


We may regard each of the differences {S,,(x) — Sn,_,(x)} as a term 
of a new series and denote the sum of the first k terms given in (2) 
by Sy,(c). We have then for all values of z in (a, b) and for all 


> r 
values of nm > m | Si, (x) — f(a) |<, 


which is none other than the condition that the series 
S,,(z) + {82,@) —Sn,@)} +: > + + {S,,(0) — Sn, @)} +> +: 


converges uniformly in the interval (a,b). If in the grouping of 
terms the order of the original terms has not been changed, the new 
series converges to the same limiting function as the original series. 
If the given series converges absolutely for each value of x, the same 
is true even though the order is disturbed by the grouping of the 
terms. 

Another special form of convergence has been introduced by 
Arzela, called quasi-uniform convergence.’ This form of convergence 


1 See Bologna Rendiconto (Apr. 1884); also ibid. (Nov. 1902). 
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differs from ordinary uniform convergence and from simply-uniform 
convergence in that the inequality (1) does not necessarily hold for 
any single value of n and all values of x in the given interval. Quasi- 
uniform convergence of an infinite series may be defined as follows. 

If for each value of n 
from a certain point on, 
say n > m, there exists a 
finite number of values 
nz; > n, such that for an 
arbitrarily small value of 
e there exists upon each 


line (Fig. 47) through A 
k 


and parallel to the X-axis 

an interval of length 6,, 

Fic. 47. which may vary with z, 

such that the sum of the 

projections of these intervals upon the X-axis just fills the given 

interval (a, b), and if for each x on the broken line thus formed from 
these intervals we have 


| Ra,(2) | = | Sn,(x) — f(x) | < «, (3) 


then the given series is said to converge quasi-uniformly in (a, b). 

It follows from this definition that any series which converges 
uniformly or simply-uniformly converges also quasi-uniformly. The 
converse, however, is not true. Thus in Ex. 7, Art. 59, it was seen 
that the series for which we 
have 


y 
NX 
IL Se oe 


Sn 


does not converge uniformly 
in the interval (0,1). The 
reason for the non-uniformity 
of the convergence is the 
presence of a peak of the ap- 
proximation curve in the neigh- 
borhood of the origin. Along 2 


the line x = , the value of 


y = S,(2), 
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is always 4. However, for a finite number of values of n, say n = nk, 
nz > m, there always exist intervals on the lines 


eh 


where 7, varies with z as indicated in Fig. 48, so that for every z in 
on the broken line made up of these intervals the inequality (3) is 
valid, and hence the series converges quasi-uniformly. 

If a series converges quasi-uniformly in a given interval, except 
for a finite number of subintervals the sum of whose lengths may be 


made arbitrarily small, then the series is said to converge quasi- 
uniformly in general in the given interval. 

The question of quasi-uniform convergence is of special importance 
in considering such questions as the integration of a series term by 
term, the continuity of the function defined by a series, etc. As 
will be seen at once, the quasi-uniform convergence of a series is a 
special case of the quasi-uniform convergence of a function f(z, y) 
to the limiting function f(z, yo) already discussed in Art. 26. Con- 
sequently, the theorems there developed can be restated without 
proof for the case of infinite series. For example, we have from 
Theorem XI of that article the following theorem. 

TuroreM I. Let the series X u,(x) of continuous functions un(2) 
converge in the closed interval (a,b). A necessary and sufficuent condition 
that the function f(x) defined by this series is continuous in (a, 6) ws 
that the given series converges quasi-uniformly in this interval. 

That a function defined by a series of continuous functions is 
not necessarily continuous has already been pointed out in connec- 
tion with Ex. 1 of Art. 59. The function there defired by a series 
of continuous functions is discontinuous at the point x =0. It fol- 
lows from the discussions in Art. 28 of the limiting function f(z, yo) 
that ifa function f(z) is defined by a series of continuous functions, 
then f(x) can at most be point-wise discontinuous. Moreover, it may 
be shown that the converse of this statement is also true; namely, 
every point-wise discontinuous function can be defined by a converg- 
ent series of continuous functions.!. We are therefore led to the 
conclusion that a necessary and sufficient condition that a function 
defined by a series of continuous functions be continuous is that the 
function is at most point-wise discontinuous. 


1 See Baire’s Lecons sur les fonctions discontinuous, p. 124. 
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If one is interested in the continuity of the function f(x) at a 
single point x) rather than in an interval, then one may set up a 
necessary and sufficient condition by making use of Theorem X 
Art. 26. Stated for the case of an infinite series, it is as follows. 


THEOREM II. Given a series 2 n(x) of continuous functions u,(x) 
which converges in the closed interval (a, b) and defines the function f(z). 
In order that f(x) be continuous at any point x» of this interval, vt rs 
necessary and sufficient that for every value of n however large there 
exists an integer %, > n and likewise an interval containing the point 
Xo as an inner point, which interval may vary in extent with %, such that 
for all values of x in this interval we have. 


| f(z) — Sn,(@) | < €, 


where € is an arbitrarily small positive number. 


61. Integration of series. We shall now inquire into the condi- 
tions under which one may integrate a series term by term and 
thus obtain the integral of the function defined by the series. By 
the integral of the function thus defined, we understand the integral 
of the limit of S,(z) as n becomes infinite; that is, we have 


b b 
{i f(x)dx = if LS, (a) ids, 
b 
On the other hand, the determination of df f(x)dx by the integration 


of a series term by term implies that we have 


[eae = LZ. (fs S,(x)dz. 


The question is then as to the conditions under which one may 


write b b 
i L Sx(x)dx = L J'S.@ae. 


That this is not always possible, is shown by the following example.' 


Ex. 9. Given the series, the sum of whose first n terms is nze-"*?. Show that 
this series can not be integrated term by term and thus obtain the integral of the 
function defined by the series. 


1 1 1 
We have L S,(x)dz = f L nae dz = f 0-dz = 0. 
i t) 


on-—-o ono 


1 For other illustrations, see Hardy, Messenger of Mathematics, Vol. 44(1915), 
p. 145. 
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On the other hand, we have 
Li eee 


== 


“ F 
fied tReet rad kerr eee 


nO “0 nC “0 nm 0c 2 


As these two results are different, the given series if integrated term by term does 
not give the integral of the function defined by the series. 


The problem to be considered may be regarded as a special case 
of those questions already discussed in connection with functions of 
two independent variables. For, we need only to replace the variable 


: 1 : . ; . 
y in f(x, y) by = and consider the resulting function for integral 


values of n. Similarly, from those theorems concerning sequences 
of functions {f,(2)} we have corresponding theorems for infinite 
series; for, we can always replace f,(x) by S,(v) and restate the 
theorems. 

If each of the terms of a given series 2 wn(x) is integrable, one 
may question whether the function f(x) defined by the series is also 
integrable. The answer to this question is given by Theorem II, 
Art. 46, and may be stated for infinite series as follows: 


TuroreM I. Given a bounded function f(x) defined in the interval 
(a, b) by the infinite series X un»(x), where un(x) 1s bounded and in- 
tegrable in the given interval. A necessary and sufficient condition that 
f(x) is integrable in (a, b) is that the series Z uUn(x) converges quasi- 
uniformly in general in (a, b). 


We have seen that the indefinite integral of an integrable func- 
tion is a continuous function throughout the interval of integration. 
Under certain conditions this is also true of the sum of the indefinite 
integrals of the terms of a series. In other words, it may happen 
that (x) defined by the relation 


(2) = Le i *Sula)de, 


where S,,(x) is integrable, may be a continuous function. 

One might infer that under these circumstances the given series 
could be integrated term by term and the series of integrals thus 
obtained represent the integral of the function defined by the series. 
That this is not always the case is shown by the following illustra- 
tion.! 

1 See Vitali, Rendiconti del Circolo Mathematico di Palermo, Vol. 23 (1907), 
p. 155; for another illustration of same kind, see Osgood, Amer. Jour. of Math., 
Vol. 19 (1897), p. 167. 
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Let S,(z) be defined in the given interval (0, 1) as follows: 

S,(a) = 1 in the interval (0, 1), 

So(z) = 4 in the intervals (0, $), (3, §) and otherwise zero, 

S3(x) = 9 in the intervals (0, 37), (4, 34), @, 2#) and otherwise zero, 

i i ee eR a ORS ont 1) and other- 

S,(«) =n? in the intervals ee +={) k=9, 1, 2, n— 
wise zero. 

It will be observed that the number of intervals where S,(x) is different from 
zero is always the same as the subscript of S,(z) and the value of S,(z) is so 
chosen that the sum of the areas bounded by S,(x), the X-axis, and the two 
ordinates, z = 0, « = 1, is always numerically equal to one. Hence, upon pass- 
ing to the limit, we have L [Seeorar as 

nc 0 


On the other hand, the series defines a function f(x) which is zero for all values of 
zx in the interval (0, 1) except for a set of points Z, where f(x) becomes infinite. 
The set H is of measure zero, since the measure of the set H, where S,(2) is dif- 
ferent from zero is of measure ae and 
iL 
E)= L = (I. 
mt ) no n? L 
The set E is, however, everywhere dense in (0, 1) and consequently f(z) is not 
integrable. 
The given series, therefore, defines a non-integrable function although the 
series of the indefinite integrals of the individual terms converges to a continuous 
function. 


A condition under which we may integrate a series term by term 
and obtain the integral of the function defined by the series is given 
by the following theorem, which is a special case of Theorem III, 
Art. 46. In this theorem we shall consider the case in which S,(z) 
is bounded as to n and x taken together; that is, we shall assume 
that S,(2) does not exceed a finite number M for all values of 
x in the given interval and for all values of n greater than some 
integer m. 


TuHeEorEM II. Given a function f(x) defined in the interval (a, b) 
by the series Z un(x), each term of which is an integrable function of 
x. If there exists a finite number M such that for all values of n greater 
than some integer m, and for all values of x in (a, b), we have 


(5), ees 
then i G@de = a "S.(a)de, a<a Sb, 


provided the given series converges quasi-uniformly in general in (a, b). 
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This theorem is equivalent to saying that if S,(a) is integrable 
and bounded as to n and x together and converges to an integrable 
function f(x), then the given series can be integrated term by term. 

Since any series which converges uniformly to a bounded function 
satisfies the conditions of the foregoing theorem, we have the following 
corollary. 


Cor. Let f(x) be a bounded function defined in the interval (a, b) 
by the series 2 un(x), where un(x) is a bounded, integrable function of x 
in (a,b). If D un(x) converges uniformly in (a, b) then 


J, t@az = J/SnCa)an, ax<azsb. 


It is to be noted that the foregoing condition for the integration 
of a series term by term applies only to integration over an interval, 
6 


that is to the definite integral ip f(x)dzx or to the indefinite integral 


=z 


i f(x)dx, where a< «<b. If the integration is taken without 


a 
reference to an interval but merely as the inverse of differentiation, 
uniform convergence no longer necessarily gives a sufficient condition 
for term by term integration of a series, as the following illustration 
shows. 
Given the series 
x i x Ay 
see 4 —— Se 
(1 + 2”)? ij (Q4-2°)? (8 + 27)? : (nm + x7)? 

This series converges for all positive values of x. It is also uniformly convergent, 
as may be seen from the application of the Weierstrass M-test, since for all posi- 
tive, finite values of z, we have 


Daas 2 


and the latter series is convergent. 
Integrating each term and assuming in each case the constant of integration 
to be zero, we have 


Ey Oe De eed = Re eee te x | 
-3|i¢eto¢a* rer fa 


which does not converge for the values of z in any finite interval. If, however, 


seers 2 xd 
we take the indefinite integral f n+ 
e . 
if wo the series of integrals in each case converges and represents the in- 

n 
teoral, taken between the same limits, of the functions defined by the given series. 


»0 <z <1, or the definite integral 


It is possible for S,(x) to be a bounded function of x for each 
value of n and still not be bounded in z and n together. The series 
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considered in Ex. 3 of Art. 59 furnishes an illustration. The function 
defined by the given series, while finite, may or may not be bounded 
in the neighborhood of such a point. As a consequence of Theorem 
IV, Art. 46, we have the following theorem. 


Turorem III. Let f(x) be a bounded function, defined in the inter- 
val (a, b) by the series Dun(x), where each un(x) is a bounded, integrable 


function of x. Then if the limit L i S,(x)dx exists and defines a 
continuous function, we have yee ae 


iE Y@de = L ls "S,(a)dx, a< x Sb, 


provided the points of (a,b) in the neighborhood of which S,(x), con- 
sidered as a function of (x,n), has no finite upper bound form an 
enumerable set and the given series converges quasi-uniformly in the 
given interval. 


If one makes use of the Lebesgue integral, the conditions for term 
by term integration are somewhat changed. First of all, it is to be 
observed that if a series of summable functions converges to a 
bounded function f(x), then this function is summable. This result 
follows at once from the fact that every summable function is meas- 
urable and a sequence of measurable functions defines, by the corol- 
lary to Theorem X, Art. 49, a measurable function. If then f(z) is 
also bounded it is of course summable. From Theorem VII, Art. 51, 
we have the following theorem for series of measurable functions. 


TureorEeM IV. Let 2 u,(x) be a series of measurable functions, each 
of which is bounded as to (x, n) together on the set of points E. Then 
af the series converges to the limiting function f(x), we have 


ip f(a)dx = Lf S.(o)de. 


In case the terms of the given series are summable we have as a 
special case of Theorem VI, Art. 53, the following theorem. 


TueoreM V. Let 2 u,(x) be a series of summable functions converg- 
ing to the limiting function f(x) on the set H. If we have | S,(x) |< (2), 
n=1,2,3---, where $(x) ts positive and summable on E, then f(x) is 


summable and 
fi@ar- L. fs.aaz. 
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Finally, if the terms of the given series 2 u,(x) are either zero or 
positive for all values of x of a given set H, we can state a necessary 
and sufficient condition for the term by term Lebesgue integration 
of the series as follows [see Theorem VIII, Art. 53]. 


TuHeoreM VI. Let > un(x) be a series of non-negative, summable 
functions having the sum f(x). Then a necessary and sufficient con- 
dition that f(x) 1s summable and that 


[sea = ee J Sula)dr, 
is that the integrals ie S,(x)dzx are equi-absolutely continuous on E. 


62. Differentiation of a series. One can not differentiate every 
series term by term and thus obtain the derivative of the function 
defined by the series. Since the derivative of a finite number of 
terms is the sum of the derivatives of those terms, it follows that 
differentiating a series term by term is equivalent to writing 

L D:{S,(a)} = D.{ L S,(2)}. 
For example, in the series discussed in Ex. 7, Art. 59, we have for x = 0 
1 n Ax 
a. Dz[Sn(z)J,-9 = 254 Ree {ag ew mee = 
On the other hand, we have 
De| L su(z) } Desh aee = De 00. 


n— co new Lie nx? 


1b eX 


Consequently, the given series can not be differentiated term by term at x = 0. 
The following theorem gives a convenient criterion for the term 
by term differentiation of an infinite series. 


Turorem I. Given a function f(x) defined for the interval (a, b) by 
the convergent series  Un(x), and suppose that the derivative Un(x) exists 
for all values of n and that the series Un(x) converges uniformly in 
(a,b). Then the derivative f'(x) exists at Xo, and 


f'(%o) = Z Un (ao) » aS % SD. 
Since the derivative of each term exists, we have 
Sil (a) = ui (a) +ur@) +--+ + ig (2); 


for all values of n. Since the series un (x) converges uniformly in 
(a, b), it follows that for all values of x in this interval we have 


| Ra (xz) | << €, n> m, (1) 
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where R,,(x) denotes the remainder of the given series after the first 
n terms and m is independent of x. For convenience, set 


S,(z + Az) — S,(x) 


S (n, Az) = ne (2) 

where z is any point of the interval (a, b). We then have 
f@= LL st, Az), (3) 
D Un (2) = zi ts 3° (n, Az). (4) 


n— co 


The required relation is then nothing else than the interchange of 
the order of limits and we can make use of Theorem VI, Art. 24. 
We shall show that the conditions of this theorem are satisfied. 

The first of these conditions is satisfied from the fact that the 
given series converges; for, we have 


L S(n, Ae) $249 SO), | ng <a, 


Moreover, from the existence of u,/ (x), we have 
LS, Az) = S;@). 
Az—0 


The second of the required conditions is satisfied, because of the 

convergence of the series of derivatives, thus giving the relation 
L Si(@) =A 

To show that the third of the given conditions is also satisfied 
we shall make use of Cor. 3 to Theorem VII, Art. 31, by which we 
know that the least upper and greatest lower bounds of a deriva- 
tive are the same as those of the corresponding difference quotient. 
Consequently, from (1) we have 


R,(a + Ax) — R(x) 
Ax 


Remembering that Ri@) = f(x) — Sa(@), 


< €, Ar = 0. 


the foregoing relation may be written in the form 


Ax 


< € 


for all values of n > m and for all values of | Az | < 6. This relation, 
however, is none other than the third condition of the theorem already 
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quoted for the interchange of the order of limits in (3) and (4). 
Consequently, we have f(x) =D ul (2) 


where x is any point of the interval (a, 6). 
This theorem gives a sufficient but not a necessary condition as 
the following example shows. 


Ex. 1. Giventheseries whose first n terms have the sum S, (x) = i log (1+n4z?). 


Show that the series Lu,’(z) does not converge uniformly, but that the given 
series can be differentiated term by term. 
We have as the result of term by term differentiation 
Duy!(n) = L- DeSalz) = L Dz aq log (1 +n‘) 
Pa Qn? 


n— oo 
zx 


nx n> 


2 eee 
none eb Tepe 1! 
Saatecl 

n 


= 0. 


The given series converges in the interval (0, 1) to the value zero. Consequently, 
we have for z in this interval 

f'(z) =0 = Zur (z). 
The series of derivatives Du,’ (x), however, does not converge uniformly, since the 
simultaneous limit L S,/(x) does not exist at the point x = 0. 


zZ—IX 
no 


If we make use of the Lebesgue theory of integration, we can 
establish the following theorems for term by term differentiation of 


an infinite series. 


Turorem II. Given a function f(x) defined for the interval (a, b) 
by the convergent series D un(x), and suppose that the derivative Un (x) 
exists and that the series Z Un(x) converges to a continuous function 
(x). Then, if Sn (x) 2s bounded as to x and n together, the derivative 


f' (x) exists and f(a) = Dui (2). 
As the series  u,/(x) converges and defines the function $(x), we 
have (2) = uf(@) tuf@) +> -tu@+--°- ©) 


Since S,/(x) is bounded as to x and n together, it follows from The- 
orem VII, Art. 51, that the foregoing series can be integrated term 
by term in the Lebesgue sense, and hence we have, by use of Theorem 


V, Art. 54, 


f-e@ae = f “ul(e)ae + [ul@ae foes +f ud(eae Sta 
= w(x) — (a) + ua(z) — (a) ++ + + + Uae) - Un(a) + ° 
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Since the series L u»(x) converges, the series Z u»(a) must also con- 
verge and the foregoing series then converges absolutely. Hence, we 


it 
Mf G@hde = Bugle) ~ B unla) = J) - 10) 


Because $(x) is continuous, it follows that the indefinite integral 
Hie $(x)dx has $(x) as its derivative at each point of (a,b). Con- 


sequently f(z) must also have a derivative and we have upon dif- 
ferentiating the foregoing relation 


(x) = f' (2) 
as was to be proved. 
By aid of Theorem VI, Art. 53, we can state a corresponding 
theorem for the case where S,/(z) is non-bounded but less in abso- 
lute value than some summable function. 


TuHeorEM III. Given a function f(x) defined for the interval (a, b) 
by the convergent series D u,(x). Suppose that the derivative un (a) not 
only exists but is bounded and that the series 2 un (x) converges. If for 


all values of n the integrals i S,/(x)dx are equi-absolutely continuous, 
then f'(x) exists and 
f(z) = 2 un (2) 
for all values of x in (a, b) with the exception of at most a set of measure 
zere. 
As we have seen,! if the integrals f S,/(2)dx are equi-absolutely 
continuous, then the integrals ip S,(x)dz are bounded for all values 


of n. As in the proof of the previous theorem, we let 
$2) = w(t) tul@) t+ + tale) be 


By hypothesis, the integral of the sum of the first » terms of 
this series is equi-absolutely continuous and hence summable. By 
Theorem IV, Art. 53, the function ¢(zx) is also summable for values 
of x in the given interval (a, b). It follows from Theorem V of the 
same article that we have 


[s@de= 1 L _ [Slade = [ul@ae + fou Sta)\de oe 


+ [oud ede + = tates 


1 See p. 301. 
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Since u, (x) is bounded for all values of x in (a, b), it follows by 
Theorem VIII, Art. 38, that u,(#) is continuous and of limited varia- 
tion. Consequently, w,(x) is absolutely continuous,! and wu, (x) satis- 
fies the fundamental law of integration [Theorem III, Art. 54] and 
we have from the above relation 


f b(x)dx = u(x) — wi(a) + U2(x) — ue(a) + - 
+ Un(t) — Un(a) ++ + + = f(x) -f@). 
Differentiating we have, by Theorem III, Art. 54, 


P(x) = f'@), 


for all values of x in (a, b) with the exception of at most a set of 
points of measure zero. 

It may also be shown? that in case f(x) is defined by a series 
> u,(xz) of monotone, increasing functions, then the series can be 
differentiated term by term for all values of x with the exception of 
at most a set of points of measure zero. 

63. Power series. It is not the purpose to include in this chapter 
a discussion of the properties of various special types of series. 
However, power series play such an important rdle in the theory of 
functions that it seems best to depart from this purpose far enough 
to include some of the general properties of such series. By a power 
series we shall understand a series of the form 

Ay + E+ Ak? +> - > +O t-- -, 
where n is a positive integer and the a’s are constants. For the 
present purpose we shall also regard the coefficients a, as real num- 
bers. If n is negative or fractional, the series may be spoken of as 
power series with negative exponents or with fractional exponents as 
the case may be. 

Among the special properties of power series, we have those given 
in the following theorems. 


TuroreM I. If there exists a value x for which all the terms of 
the power series X a,2 are less in absolute value than some number 
M, then the given series converges absolutely for all values of x such 


allo <<" | fo | 
1 See remarks following Theorem VII, Art. 38. 


2 See Fubini, Rend. Atti. Acc. Lincei (Rome), Vol. 24 (1915), pp. 204-205; 
also Rajchman and Saks, Fundamenta Math., Vol. 4 (1923), 211-213. 
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Since, by hypothesis, | a, 23 | < M, we have from the given series 


[ao| + |arz| + |a2a2|+- . + | Qna"|+- gOS 


2 
+ | a x | 2| +++++|[Gn25| 


|ao| + | a1 20 | 


ip || 
as +-+:-. 
Xo 

2 ap 


eo 
0 


If the series in the second member of this inequality converges, 
then the given series converges absolutely. However, the series in 
the second member is a geometric series and converges for those 
values of x that make each term numerically less than one, that is for 
those values of « where 


x 


Xo 


sm {1+ |=] + 


|x| <|2ol, 
which was to be shown. 
It is to be noted that a power series is always convergent for 
x= 0; 
TueroreM II. If a given power series X anx” converges for x = Xo, 
then it converges absolutely for those values of x for which |x| < | 2 |. 


By hypothesis, the series 
Ao + MX + Axo? + + + + + Ano” + - 
converges. It follows that the n* term must approach zero as n be- 
comes infinite. There must then exist a positive number JM such that 
for all values of n we have 
| An” | <= M ? 

and consequently by Theorem I the given series converges abso- 
hutely fora |<" 25 

TueoreM III. Jf a given power series D anx" is divergent for 
XL = Xo, then rt diverges for all values of x such that |x| >| a0| . 


Let x, be any value of x such that |2| > |ao|. If 2 a,x” were 
convergent for x=2, then by Theorem I it would also converge for 
x=2o, which is contrary to the given hypothesis. From this contra- 
diction the theorem follows. 

A given power series may converge for all values of 2, or it may 
converge for some values and diverge for others. Thus the series 


l+ot+art+eet- - -+a4+- 


converges for all values of x in the open interval (— 1, 1) but diverges 
for all values of x exterior to this interval. It is of importance to 
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determine whether there always exists a point which separates 
the points of convergence from those of divergence. The following 
theorem gives the answer to such an inquiry. 


TuroreM IV. For a power series Zanx” which converges for some 
values of x #0 but is not always convergent, there exists a definite 
number p such that for |x| < p the series is convergent and for |x| > p 
the series 1s divergent. 


By hypothesis, there must exist at least one point of convergence 
different from x = 0, and one point of divergence. Denote these 
points by a, and bi, respectively. It follows from Theorems II and 
III that |a:| < |b: |. Divide the interval (um, b:) into two equal 
parts. Let 2 be the middle point of this interval. If the given series 


converges for 2, then we a, 
shall further consider the O ay by 
interval (2%, bi). If, on the Fras 40: 


other hand, the series is 

divergent for 2, we shall consider the interval (a1, 2). For the sake 
of definiteness suppose the interval (ai, 2) to be the one to be further 
subdivided. Denote it by Jo. Divide this interval into two equal 
parts and consider the left half or the right half according as the 
series diverges or converges at the middle point. Denote the new 
interval to be considered by I;. Think of this process of sub- 
division and selection of new intervals to be carried on indefinitely. 
In this manner we obtain a sequence of intervals {J,} such that by 
the theorem of Art. 7 they define in the limit a single point, which 
we shall denote by c. For every value of x satisfying the condition 
that | x | <c, the given series is convergent, and for all values of x 
such that |x| > c the series is divergent. The point c determines 
the value p which the theorem requires. 

Suppose we have a positive value p which satisfies the conditions 
that Da,x" converges for |x| < p and diverges for |2|>p. The in- 
terval (— p, p) is then called the interval of convergence of the given 
power series, and it is often convenient to speak of p as the radius of 


convergence. Thus the power series 2 2” has one as its radius of 
n=0 

convergence and its interval of convergence is, (-le1). abesin- 

terval of convergence may be an open or a closed interval. To 

determine the interval of convergence, we have the following 

theorem. 
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Turorem V. Given the power series Za,x", and denote by A the 
maximum limiting value of the sequence. 


la |; V [az]; Vv |as|; > SN ie le ° 
Then the radius of convergence of the series 1s equal to + 


This theorem can be established by comparing the given series 
with the geometric series Ya"x", which converges absolutely if 


Jax| =|a|-|2z| <1; 
1 
that is, if |x| <—- 
|a| 


Putting a” = a,, we see that the given series is convergent, and in 
fact absolutely, for those values of x for which 


Sag ee VY lata | =| ag) <1 
This conclusion is also true if we replace | a, | by the maximum 
limiting value of the sequence {| a, |}; that is, the given series will 
be absolutely convergent if we have 


At ais Vax <1: 


or iy eal eet + 
Since convergence requires that the absolute value of the terms of 
the series shall approach zero as n becomes infinite, the given series 
is divergent if we have for all values of n 

reget ree | ee pene ed 
that is, if Vs) Ge ae ele 

1 
or |2| > ———- 
V | an | 

This conclusion is still true if we replace Y | a, | by the maximum 
limiting value of the sequence of these values as n becomes infinite, 
that is by A. We then have the conclusion that the series Da,x" is 
divergent whenever 


1 
ltl >a 


Since the given series is convergent for |z| less than 7, and 
divergent for |2| greater than this same value, it follows that 


7 is the radius of convergence as the theorem states. 
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In case the sequence V | a, | has a definite limit, then of course 
that limit is itself the radius of convergence. 


TuroreM VI. The power series Lanx” converges uniformly and 
absolutely in any interval which falls entirely within the interval of 
convergence; that is, for the values of x satisfying the condition 


| x | = | Xo | < Pp; 
where p is the radius of convergence. 


However close 2» may be to p, we can always select a value % 
such that | 2. | < | 2 | <p. The series of absolute values gives 


fof lorie leo lar |e sta | elon 
2 |? Iz ie 
STE ALS ee eee Fg pels ray ee 
+ law’ | G+. Fleet 
By Theorem IV the given series converges for Pee eal tas |<). Lt 
follows that Tio ene70! 


and hence there must exist a definite value M for which 
pat | le Oar ae ae 


Hence, from (1) we have 


2 n 
2 at” | <u {i+j2t+ Lee : ee ala : J. 
| a1 | | a1 | 

This latter series converges for || < |a1:| and therefore for | als Pee 
Hence, Da,2” converges for the same values of x. However, the value 
zy is any value less than the radius of convergence Pp. One may, 
therefore, state the result by saying that the given power series con- 
verges absolutely for all values of x in any closed interval lying 
wholly within the interval of convergence of the given series. 

That the series also converges uniformly in the interval for which 
|x| S|2o|, follows at once from the application of the Weierstrass 
test for uniform convergence. The largest numerical values of the 
terms of the given series are obtained by taking the extreme values in 
the closed interval (—2o, x0). As the given series converges absolutely 
for such values, it follows that the Weierstrass test is satisfied and 
hence the given series converges uniformly in this interval. 

It is to be noted that while the interval of uniform convergence 
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is necessarily closed that of absolute convergence may be closed or 
open. 

Since the terms of a power series 2a,2” are continuous functions 
of x, it follows from the foregoing theorem that the function defined 
by such a series is also continuous. We may, therefore, state the 
following theorem. 


TuroreM VII. A power series 2a,x” defines a continuous function 
for all values of x in the interval (— Xo, %o), where |x| ts less than the 
radius of convergence. 


At the end-points of the interval of convergence, the continuity of 
the function defined by a power series is determined by the follow- 
ing theorem. 


TueoreM VIII.! If the power series Zanx” converges for x = p, 
where p is the radius of convergence, then the function f(x) defined by 


this series is continuous on the left at x = p; thatis, L Lanx” = Lanp”. 
z—>p 


A similar statement holds for the right-hand continuity at x = — p 
af the series converges at that point. 


We shall prove the first part of the theorem. A similar proof 
applies to the second part. 

It is to be noted that we may, without loss of generality, assume 
p=1. For, if instead of the series 2a,x" having the radius p we 


take the series 2 b,7”, where 6b, = a we have a series whose radius 
of convergence is one. Assuming, then, that p = 1 and that the series 
Da,t converges for x = p, we have 


S(@) = Zana", (2) 
and fl) = 2a, = A. 
: 1 

Since we have 1 eee Ze", LODiee eas (3) 
we may write i : 7 Lgl? = Lgl ae, (4) 
where Sn = 40 +@,+ G2 ++ + + +a, 
From (2) and (4) we have 

{@) = =a) 25.7". (5) 


1 See Abel, Jour. fiir die reine und angew. Math., Vol. 1 (1826), Deolis 
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From (3) we obtain Wess (OMe Pins 
and consequently it follows that 
A = Za, = (1 — 2)Z Az". (6) 
Subtracting (5) from (6), we obtain 
A — f(a) = (1 —2) D(A — S,) 2". (7) 


For n sufficiently large, the difference | A — S, | is arbitrarily small, 
and hence we may write 


| A—S, | < 510 > m. 
From (7), we have for |x| <1 


|A-7@|s|0-H Z4-s)|+$|a-9 2 | @ 
n=0 n=m+1 
Put |A—-S|+{/A—Sel+- - -+|A—-Sn| = 8B, 
and we have from (8) 
m+1 
[4 -7@|s Ba -2) +§[a-9- 5] (9) 


Aa 
2B 
where 1 — 6 <a <1, we get from (9) 

€ 


E 


which shows that f(z) approaches A as x approaches 1 on the left. 

As we have seen, a series whose terms are continuous functions 
can be integrated term by term in any elosed interval in which the 
series converges uniformly. Moreover, if we differentiate a power 
series term by term, we obtain a power series, which again converges 
uniformly by Theorem VI. We may, therefore, state the following 
theorem. 


If we now put O= 


€, 


Turorem XI. Every power series may be integrated or differen- 
tiated term by term in any closed interval which lies within the interval 
of convergence of the given series. 3 

To determine the interval of convergence of the series obtained 
by integrating or differentiating a power series term by term, we have 
the following theorem. 

TuroreMm X. The series resulting from the differentiation or inte- 
gration of a power series term by term has the same interval of con- 
vergence as the original series. 
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Let the given series be Da,x*. We are to show that the series 
Zna,c" and 2 . ae 
the series Za,x”. ‘ 

The radius of convergence of Lanz” is the reciprocal of the maxi- 
mum limiting value of the sequence {| a, |}. The reciprocal of the 
radius of convergence of the series 2na,v"~ is then 
L VY) n-cn| = LO Gg) 8) a 


no 


x"*! have the same interval of convergence as 


since the limit of “/n as n becomes infinite is one. Similarly, for the 


series 2 = [*" the reciprocal of the radius of convergence is given by 
n 
ae An a =n ; n | 1 x a n/ 
of. wel Pee aed 7 pv lanl: 


because the limit of \/— ; is also one. As L ~/| a, |is the recip- 


rocal of the radius of convergence of the series Za,2”, the theorem is 
established. 

We may not only add and subtract power series, but may multiply 
such series as the following theorem shows. 


TurorEM XI. Given two power series Lan,x", 2b,x" converging 
respectively to the functions fi(x), fo(x). We may multiply the series 
together and thus obtain 


Sila) -fo(x) = Dane™-Lb,2" = U(dobn + Gibna + + + + Gnbo)a” 


for all values of x within the smaller of the two intervals of convergence. 


This theorem follows as the consequence of Theorem IV, Art. 58, 
and the fact that power series converge absolutely in any interval 
smaller than the interval of convergence. 

We may obtain the power series representation of a given function 
by means of the Taylor or Maclaurin expansion of a function, subject 
to the condition that in any case the remainder approaches zero as n 
becomes infinite. As we have seen, we may operate with power series 
in the same manner as with polynomials, including term by term 
differentiation and integration. Because of these properties, power 
series play such an important réle in the development of the theory 
of functions that those functions which can be represented by power 
series are given a special name. They are called analytic functions. 
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From the discussion of power series, it follows at once that an analytic 
function has among other properties the one that it is continuous 
and has a continuous derivative of any finite order within the interval 
for which it is defined. 

64. Condensation of Singularities. As we have seen, the terms 
of a series may be discontinuous functions and still the series be uni- 
formly convergent. From the definition of uniform convergence, we 
have for all values of n larger than some m independent of z and for 
all values of x in a given interval 


| f(x) a nie) | <a €, 


where € is arbitrarily small. This relation permits the points of dis- 
continuity of the individual terms to be also points of discontinuity 
of the function defined by the series. Hankel! has devised a method 
by which we can introduce a discontinuity of a predetermined char- 
acter at the set of rational points, that is at a set of points which is 
everywhere dense. This process is known as the condensation of 
singularities. 

For this purpose, consider a function ¢(y) which is bounded and 
continuous in the interval (— 1, 1) except at the origin, where it has a 
singularity of the required character. If we replace y by sin n7z, the 
result depends upon 7 as well as z, and we often express that fact by 
writing @,(sin naz). As x takes all real values, y takes values be- 
tween —1 and +1. Consider now the series 2c, ¢,(sin nx), where 
cn, is so chosen as to insure the uniform convergence of the series. 
For each rational value of z, that is for x = p/q, there are an infinite 
number of terms of the series c,d, (sin nx) which have the same 
singularity as was assigned to ¢(y) at y =0; because, for all values of 
n=k-q, k=1,2,3,- - -, naa then becomes a multiple of m and 
the function sin naz is zero. Under certain restrictions to be noted 
later, each of the points of discontinuity of the terms ¢,¢,(sin nz) 
are also points of discontinuity of the function f(x) defined by the 


relation f(z) = Denha(sin nz). 


As already pointed out, a singularity which occurs at a rational 
point is also present in an infinite number of terms of the series 
De,,(sin nx). It must be shown in any particular case that these 
singularities do not neutralize one another and thus not appear in 
the limiting function f(z). It is certain, however, that no discon- 


1 See Tiibinger Universitdtsschriften aus dem Jahre 1870, No. 3, p. 6. 
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tinuity can appear in f(x) which does not occur in some term of the 
series because of the uniform convergence of the given series. The 
following illustrations will serve to make clear the use and the re- 
strictions of Hankel’s method of condensation of singularities. 
Making use of Ex. 2, Art. 25, we have a function ¢(y) which is 
zero for y = 0 and takes the value one for all other values of y in the 
interval (— 1,1). Replacing y by sin n7az and putting c, = 7 we 
define the function f(x) by the relation i 


f(z) =2 + (sin nx). 


The first term of this series has a discontinuity equal to one at the 
points z =0,z=+1. The second term has a discontinuity of } at 
the points Heese eae 
Likewise the third term has a discontinuity of § at the points 

z=0,+3, 43,41. 


The general term, - (sin nx), has points of discontinuity with a 


saltus equal to -, at 


1 Zz, 3 n—1 
=O, =) = regi mated sO 6 10. 4 Ge 
n n n 


The given series converges uniformly; for, the terms are in abso- 

; 1 

lute value not greater than the terms of the convergent series 2 = 
n! 


and consequently conditions for the Weierstrass test for uniform 
convergence are satisfied. Because of the uniform convergence of 
the series, the points of discontinuity of f(x) must be among those 
values of « for which one or more of the terms of the given series are 
discontinuous. However, these points are always rational and hence 
we can conclude at once that f(x) is continuous for all irrational 
values of x. 

We shall now show that f(x) is discontinuous at all the rational 
values of x; that is, at all those values where x = P. For this pur- 
pose set up the relation q 

- 0 | sin n (? ae a)r| = sin n 2) 


s(t : i) ~#(F) ‘ fa : n! 
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For those values of n which are a multiple of q, Say n = nq, the 
second term of the numerator vanishes and the first term becomes 


sin(mpm + mgdm) = sin mpm cos ngdm + cos mpm sin ngdmr 
= + sin nr, 


where the plus sign is taken if mip is even and the negative sign if 
it is odd. We may then write 


9 sin na? =e 5) | 10) sin nar? | 
r+ 5) —7(2) -y LE tO song 
q q n! 
o(+ sin ng67) 
=; ~ mq! ; 

where 2’ indicates the sum taken by omitting those terms where n 
is a multiple of g. As these series converge uniformly, the limit of 
the sum is equal to the sum of the limits of the individual terms. 
As 6 approaches zero, the limit of the terms in the first series is zero, 
and hence we have 


Eee Motors ELLE) 


6-0 q qd Ng ! 
From the definition of ¢(y), it follows that 
o(4sin ngé7) = 1, for 6 #0. 


Hence, we have sb, P(ssin mgom) = 1, 


ria) 
and therefore L E ¢ + i 7 fal 


Since the series 2 aa converges and has a sum different from zero, it 


follows that f(x) is discontinuous for x = P, that is at all rational 
points. q 

It has therefore been shown that f(x) is point-wise discontinuous 
having the irrational points as points of continuity and at the ra- 
tional points a discontinuity of the same type as assigned to the 
function d(y) at y = 0. 

By the use of the condensation of singularities, one may set up a 
function f(x, y) which is everywhere continuous in x and in y but dis- 
continuous in (z, y) together at all points where both x and y are 
rational and continuous in (z, y) together at all other points. 
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To construct such a function, consider the region defined by 
05251,0S y21 and let 


az 
o(2, y) = ae for x, y not both zero, 
= 0, for = 0, y = 0. 


We have seen in Art. 28 that this function has an (z, y)-discontinuity 
at the origin. Replace x and y by sin? n7z and sin? ny, respectively. 


We have then ee oo 
sin? nra:sin? ny 


sin‘ nia + sin* nary 


$,(z, y) = 


This function is everywhere continuous in z alone and in y alone. 
We shall now examine it for points of discontinuity in (a, y) together. 


For n = 1, we have ona oe 
sin? ma-sin? Ty 


Pilz, ¥) = sin* wa + sin* ry 
This function has at the points 
(0, 0), (0, LB a 0), (1, 1) 


an (2, y)-discontinuity, because at each of these points the simul- 
taneous limit in (2, y) does not exist. We shall examine the behavior 
of di(x, y) at the point (1,0). At the other points, it may be ex- 
amined in a similar manner. If we put x = y+ 1 and allow y to 
approach zero, we have 


sin? r(y +1)-sin? ry _ sin’ ry-sin? ry 1 
yo sint wr(y+1)+sintry ,50sin‘ry+sintry 2 

If, however, we put x = 2y + 1, we obtain 
sin? 7(2y + 1)-sin? ry 4 cos? ry 4A 


yoo sint r(2y +1) + sin‘ ay 430 16 cost ry tl Wg. 


As these two limiting values are different, it follows that the simul- 

taneous limit ZL oi(a, y) does not exist and hence ¢,(z, y) is dis- 
y0 

continuous at this point. Ina manner similar to that used above, we 

may show that ¢2(z, y) has an (2, y)-discontinuity at each of the 

points (0, 0) (0, 3), (0, 1), , 0), G, 4), G, 1), (1,0), , 3), G, 0); 

that is, at the points where 
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At all other points ¢2(z, y) is continuous in the two variables together. 


The general term sin? yy 
in? nx: sin” nT 
a(z, y) = u 


sin* nx + sin* nary 


is discontinuous in (2, y) at the points where 


La? 
In = aime ee (ob 

nn n 

2 n (1) 
y = (0), x! a . . ee Ny 


This statement can be established by the method already applied in 
the discussion of $,(z, y); that is, by the two substitutions 


He , B 
AS Ge Paaoht enue 
Dele Bie eee B 
and e=2yo+-—2y=y + 


where “, B denote any of the values of z, y, respectively, given in (1). 


These substitutions lead to different limiting values as y’ approaches 
zero and hence @,(z, y) is discontinuous in (2, y) together at the 
points in question. 

We shall now define the required function f(z, y) by the relation 


fle, y) = E 7 bal, 9). 


This series converges for all values of the variables in the given region; 
for, since $,(z, y) is always less than or equal to 4, we have 


1 


—9. 
n! 


| ae 1 
Z  on(z, y) $5 


and 2 7 is a well-known convergent series. It follows that f(a, y) 


is fully defined for the given region. 

It remains to show that f(x, y) is continuous in each variable 
separately and then to examine this function for points of disconti- 
nuity in (z, y) together. The series defining f(z, y), considered as a 
function of (zx, n) or of (y, n), satisfies the condition for uniform con- 
vergence. As the individual terms are continuous in each variable 
separately, it follows that f(z, y) is likewise continuous in each 
variable separately. 
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We shall now show that f(z, y) has an (2, y)-discontinuity at a 
set of points everywhere dense in the given region. As we have seen, 
the first term has points of (x, y)-discontinuity at the points 


(0,0), (0,1), (1,0), GD. 


The second term contributes to the saltus at the above points and 
introduces in addition new points of discontinuity, namely, 


(0, a) (a; 0), 3, 2 ? Gs 1): (ies ° 


In general each term has some of the points of discontinuity of the 
preceding terms and also certain new points of discontinuity. These 
points of discontinuity cannot neutralize one another, since p(x, y) is 
always zero or positive and hence those terms which do not vanish are 
always positive and the amount of the saltus in (a, y) at any point 
is increased rather than diminished by the addition of new terms of 
the series. We may choose n sufficiently large so that any particular 
rational point becomes a point of discontinuity; that is, any point 
where , 
i 7 y= ma 

p, p’, 9, v’ being all integers and gq, q’ different from zero and prime 
respectively to p, p’. For this purpose we need only to take n suffi- 
ciently large to be divisible by g and g’. When this is the case, then 
nix and ny are integral multiples of 7 and ¢,(z, y) contains only 
the sines of integral multiples of 7. The amount of the discontinuity 
at the various rational points is not the same, because in every case 
the saltus of ¢,(z, y) is divided by ! and the same terms of the given 
series do not always contribute to the saltus. In fact, the amount of 
discontinuity of f(z, y) is always finite and at many rational points is 
very small, but the essential thing in our discussion is that every such 
point is a point of (2, y)-discontinuity. As these points are every- 
where dense in the given region, the points of (x, y)-discontinuity of 
f(x, y) are likewise everywhere dense. That the points of conti- 
nuity of f(w, y) are also everywhere dense follows from the fact that 
f(x, y) can be at most point-wise discontinuous. 

As a further illustration of the Hankel method of condensation of 
singularities, we shall set up a function f(z, y) which is totally differ- 
entiable at a set of points everywhere dense and yet is such that 
there exists also a set of points everywhere dense in the given region 
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where f(z,y) is not totally differentiable. In the region | x{ $l, 
| y |S 1, suppose we consider the function 
wy 
P(x, y) =, xt 4 yp 
if z, y are not both zero, and where $(0, 0) = 0. This function is not 
continuous in « and y together at the origin; for, we obtain different 
limiting values by taking different approaches to that point. As 
continuity of $(z, y) in x and y together is a necessary condition for 
total differentiability, it follows that the given function is not totally 
differentiable at x = 0, y = 0. 
For xc ~ 0, y ¥ 0, we have 
Op et 


EE ae 


For (x = 0, y = 0), for (c #0, y = 0), and for (x = 0, y ¥ 0), we have 
'_0. For (x #0, y # 0), we have 
4 2 
oP 
while for (rx =0, y=0), (e =0, y #0), we have $, =0. For 
(x ~ 0, y = 0), we obtain oy = = 

Although the given function is not totally differentiable at the 
origin, yet in every neighborhood of that point including the origin 
itself, the two partial derivatives $4, , exist and one of them, 
namely $2, is continuous in 2 alone and in yalone. The partial de- 
rivative /, is everywhere continuous with respect to y. It is also 
continuous with respect to x, except at 2 = 0, y = 0. 

‘As we have already seen,! if the partial derivatives fz, fy exist for 
all values of (z, y) in the given region, then the points at which f(z, y) 
is totally differentiable form a set everywhere dense in that region. 
However, the points at which the given function f(z, y) is not totally 
differentiable may also form a set of points everywhere dense in 
the same region, as we shall now show. 

Consider the function 


Sen | 
f(z, y) = ze n!\ ox(Z, Y); (2) 
where @,,(z, y) is formed from the function #(z, y) considered above 
by replacing x by sin?nrax and y by sin’nzy; that is, 
sintnax + sin’nry 
Pal, y) = sintnaa + sin*niry 
1 See Theorem IV, Art. 34. 


2 
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The function $(z, y) takes the value one-half for y = 2? ¥ 0, but 
for all other values of x and y in the given region it is less than one- 
half. The amount of the (2, y)-discontinuity at the origin is one. 
Since the sine is never greater than unity, we have 

2 + bale, 9) Pas a 
n=1 G 


n=1 n! 


F : 1 ; 
As the latter series converges, the series al ,(x, y) converges uni- 


formly as a function of the two variables (x, y) and hence as a func- 
tion of either variable separately. As we shall see, the function f(z, y) 
is not continuous in x and y together throughout the region of defini- 
tion, because each term of the series is discontinuous at certain points 
in these two variables. However, $a(z, y) is continuous in x alone 
and in y alone; and because of the uniform convergence of the above 
series, f(x, y) is continuous in each variable separately. Conse- 
quently, the points at which it is continuous in both variables must 
form a set everywhere dense. 

We shall now show that the points at which f(z, y) has a discon- 
tinuity in x and y together also form a set everywhere dense, being 
those points where both x and y have rational values. 

The first term of the series (2) has a discontinuity in x and y at 


(0,0), (0, +1), (1,0), (41,+1); 
the second term at the points 
el Og te ly tO 
In the general term we have such a singularity at points (z, y) for 
which we have any combination of the following values: 
Leas ate n-1 


|x| =0,-> re mA me su 
12 3 n—I1 
Pah: n’ ead) 7 real le 


It follows that any point whose codrdinates (x, y) are both rational 
numbers is a point of discontinuity of some term in the series defining 
S(x,y). It will be observed that none of the terms of the series given 
in (2) are ever negative, whatever values may be assigned to x and y. 
The points of discontinuity of any term are likewise points of dis- 
continuity of an infinite number of subsequent terms but not neces- 
sarily of previous terms. Moreover, the discontinuities at a given 
point can not be combined so as to cancel one another or to cause 
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the function f(z, y) to have an infinite discontinuity at any point. 
For, if a point first appears as a discontinuity, say in the kth term, 
the sum of the discontinuities of subsequent terms at that point 
can not equal in amount the discontinuity of the kth term. For 
example, consider the discontinuity which appears at the rational 
point (x = 3, y = 4). This point will appear as a discontinuity for 
the first time in the third term. The amount of the discontinuity in 


this term is aa = ae The amount of the discontinuity of subse- 
quent terms at this point can not exceed 

a Pere ee! yal ee 1 iglese iat 
aie slo" Soon aa pee 


Consequently, all points which appear as points of discontinuity 
of any term are also points of discontinuity of f(z, y), and hence any 
point whose codrdinates are both rational numbers is such a point. 
A function must be continuous in the two variables together in order 
to be totally differentiable. It follows then that f(x, y) as defined 
is not totally differentiable at any point where the two codrdinates 
are both rational numbers. Such a set of points is everywhere dense 
in the given region. 

We shall now show that the points at which f(z, y) is totally 
differentiable are also everywhere dense in the given region. To do 
this we proceed as follows. As we have seen, $; is continuous in 2 in 
the closed interval —1 S x $1; hence for any constant value of y, say 
y = Yo, the numerical values of $2(x, yo) have a positive finite upper 
bound. This upper bound, which we shall denote by Mo, may change 
with the choice of yo, but the essential thing is that for each value of 
yo it is finite. For y = Yo, we have, since sin nrx and cos n7x are 
numerically never greater than one, 

|e < 2rnM,j | sin nrz-cos nrx | S 2an- Mo. 


Hence, we have for a constant value of y 
1 doe! < § 2nMo 
far (OL 1 yan —1)! 


As this last series converges for —1 S$ x S 1, it follows that the series 


foe) 


n 


2 i RL converges uniformly in this same interval, and we may write 
n 


Ox 
Afni ie ied 0s 
On. “er! 02 
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Moreover, since a is continuous in 2, it follows that az 8 defined 


by a uniformly convergent series of continuous functions and is there- 
fore itself continuous in 2. af 

By a similar method, it may be shown that ar 8 continuous in y, 
and since this derivative is also continuous in 2, it follows that there 
exists a set of points everywhere dense where it is continuous in x 


and y together. eee 
We shall now consider the existence of the partial derivative an 


From the discussion of $(z, y), it follows that @) is continuous in y 
in the closed interval —1 S y S$ 1. Then, for any constant value of x 
it is bounded, and hence we may write 

Ea 


ay |= 2n7M, | sin nry-cos niry | S 2n7M,, 
Y 


where M, is a positive constant for each previously selected value of 
x. Consequently, we have 
nai |! oy n= 1(n—- 1)! 


1 ddr 
Since the last. series ae 
uniformly, and hence we may Write 
Ff _ F 1 Abn, 
oy n=1 n! oy 
of of 


Therefore, the partial derivatives ne both exist at every point in 


the given region and a is continuous in x and y together at a set of 


points everywhere dense. It follows that f(z, y) is totally differentia- 
ble at each of these points. 

We have then a function which is totally differentiable at a set of 
points everywhere dense, and at the same time there exists a set of 
points likewise everywhere dense at which this function is not totally 
differentiable, in spite of the fact that both of the first partial deriva- 
tives exist at every point and one of them is everywhere continuous 
in each variable separately. Geometrically, the corresponding sur- 
face has a tangent plane which is not parallel to the Z-axis at a set 
of points everywhere dense and there exists simultaneously another 
set of points at which no such tangent plane exists. It can be shown, 
moreover, that the points at which these tangent planes exist; that is, 
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the points at which the given function is totally differentiable, must 
form a set having the cardinal number of the continuum. It will be 


Of . : : 
observed that = is not continuous with respect to x. By the method 
used in discussing the continuity of f(z, y) it can be shown that 


zt is discontinuous in x at a set of points everywhere dense, namely 
at the points where z and y are rational numbers. 

The foregoing method of condensation of singularities has certain 
disadvantages. By that method we are able to introduce a given 
singularity only at the rational points, whereas it is often desirable 
to select arbitrarily the points at which the singularity is to appear. 
Moreover, replacing in ¢(y) the variable y by sin nx introduces 
some complication due to the fact that the number of the oscillations 
of the sine function increases indefinitely as x becomes infinite. 

Another method, known as the Cantor method ! of condensation 
of singularities, makes it possible to introduce the given singularity 
at an arbitrarily chosen enumerable set of points. Let the given 
set of points be denoted by 


U1, V2, 3, . . . } Xny . . Oi 


Suppose the required function f(x) to be defined by the relation 
f(0) = E cane — 


where the coefficients c, are positive and so chosen as to insure the 
uniform convergence of the series in the interval under consideration 
and, as in the previous discussion, $(y) has the value zero for y = 0, 
and aside from this value is a continuous function. 

As an illustration, we shall show how we may set up @ function 
f(z) having a derivative at every point in the given interval (O72) 
and this derivative be discontinuous at the set of points {vn}. Let 


f(z) = D7 bale, 2»), 


: LON oan 
x 


—~ nN 


where halt, Xn) = (€ — Xn)? sin - 
= 0, for x = Xn. 

The terms of the given series are continuous and the series converges 

uniformly in the given interval; for, each term is numerically not 


1 Although this method was first made use of by Weierstrass, Geo. Cantor was 
the first to present it in print. See Math. Ann. Vol. 19 (1882), p. 588. 
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greater than + and the series 2 converges. It follows that f(z) is 


a continuous function. 
By differentiation, we have for z ¥ 2, 


— cos 


Ud _— _s 7 A 
Oj (2, tn) = 2(@ — Ge) Sin aaa PWT 


For x = Zn, we have from the definition of a derivative 


1 
bn(x + Ax, Ln) — n(Z, Tn) _ A2x sin Ax - 
$n (2, Bn) ees Ax - fies Ax oy 


The series of derivatives, namely 
the 1 
i (2, tn) + 55 PEL, En) ++ + + +75 hn(%, Tn) to +, 


converges uniformly in the given interval (0, 1); because, for all 
values of n and x we have 


gn (2, Xn) < 3, 
and hence D2; “ Dalty fas 3, 


which shows that the Weierstrass M-test for uniform convergence is 
satisfied. We can then differentiate the orignal series term by term 


and write : Ade) 
ij (x) =2 n2 Dn (x, Tn). 
Because of the uniform convergence of this series we may also write 
Payee DS Tape ney 


The limit of the terms expressed in the second member of this relation 
does not exist because of the non-existence of the limit 


L cos 


L—-In XL — In 


Consequently, the limit L f’(x) can not exist; that is, f’(x) can not 


Lin 


be continuous at xz =2,. However, the derivative f’(x) exists at 
each of the points x = x,. Hence, f(x) has a derivative at each point 
of the given interval (0, 1) but this derivative has at the enumerable 
set of points {z,} the same type of discontinuity that $/(x) has at 
the origin, when we define #(x) by the relation: 


O(a) = 2? sin; for x 0, 
0 fora = 0; 
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65. Divergent Series. Previous to the nineteenth century, but 
little attention was paid to the convergence or divergence of the series 
used in mathematical investigations. Early in that century Fourier 
and Bolzano set up definitions of convergence. Cauchy formulated 
more exactly the conditions for convergence, and both he and Abel 
emphasized the importance of convergence in connection with use 
of series. In spite of their warning, however, certain well-known 
divergent series continued to be employed in applied mathematics 
with satisfactory results. One can see why this was possible; for, 
a series which converges for a considerable number of terms but 
ultimately becomes divergent is a divergent series from the point 
of view of the mathematician, while the physicist or astronomer 
might find such a series very satisfactory in deducing an empirical 
formula which would yield results with an error well within the 
error of observed data. While Stieltjes considered certain important 
divergent series in attempting a closer approximation to a given 
function,! and Cauchy in 1843 considered the use of Sterling’s series 
for values of the variable for which it is divergent, no real progress 
was made in the investigation of the conditions under which diver- 
gent series may be used until Poincairé considered such a series in con- 
nection with his researches on linear differential equations.” More 
recently an extensive literature has appeared, some of the more im- 
portant results of which will be summarized in this article. The con- 
sideration of divergent series may be divided into two parts, the one 
relating to the theory of asymptotic series and the other to the theory 
of summability. 

A power series derived from a given function by Taylor’s expan- 
sion does not necessarily represent that function even in the interval 
of convergence of the resulting series. For example, it is well known 

i a 
that the function hee 


gives rise to a power series which converges for all values of x but 
fails to represent the given function for values of x #0. However, for 
very small values of x the function ¢(z) defined by the series approxi- 
mates the values of f(x) to a degree depending upon the choice Ore: 
Let us now suppose that, in the interval (0, b), the function f(x) 
gives rise to the power series 
Oy + yt +O? +> > Ont ts (2) 
1 See Ann. de Vécole normal (3), Vol. 3 (1866), p. 201. 
2 See Acta Math., Vol. 1 (1886), p. 295. 
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where we make no assumptions as to the convergence or divergence 
of this series. Let it be assumed also that 
Lf (a) = do 
z—0+ 
Likewise, we shall assume that 


L {toa | Fax 


20+ \ Lv 


L [aon ae} as 


20+ ai 
ip f(a) — do — Gye — aex?-— + + + Anz") = 
Ais = An, 
az—0+ 


If the series (2) is divergent, we can no longer speak of the sum of 
the series in the ordinary sense, but we can say that for a finite 
number of terms the series gives an approximate value of f(x) for 
small values of x. It will be noted that the smaller x is taken, the 
larger n must be chosen in order to get the best approximation to 
the corresponding value of x. A series satisfying the foregoing con- 
ditions; namely, 
fe = {f) -"S aut" } SG. Oe eee 
z—0+ n=1 

is called an asymptotic series and is said to represent the given func- 
tion f(x) asymptotically for small positive values of x. 

For large values of x, Poincaré introduced a corresponding defini- 
tion of an asymptotic series! According to this definition, f(x) is 
said to be represented asymptotically for large positive values of x 
by the series 


is 1 iN? 
or | ToC co et |e) (3) 


if the following condition is satisfied; namely, if we have for each value 


of n ee {x (1) (2 n—1 
z—+co j of ened Lx, meg *) a An, 
or what is the same thing, if we have 
1 1\n 
hee) ~a-a()—- + --al) } =o 


1 See Acta Math., Vol. 8 (1886), p. 296; see also Ford’s Studies of Divergent 
Series and Summability (1916), p. 22. 
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The relation of f(x) to an asymptotic series representing it is expressed 
symbolically by writing 
f(@) ~ a + a,() = ax(*) ee ct a, (+) Hee a (4) 
The resulting series may be convergent or divergent for the large 
positive values of x in question. In the case of a convergent series 
the actual value of f(x) is obtained when n is allowed to become 
infinite. The best approximation of f(x) by an asymptotic series is 
obtained if the series is terminated with that term having the smallest 
absolute value. If the series is of the form 2 a,2”, then, as already 
pointed out, the number of terms necessary increases as x takes 


smaller values. However, if the series is of the form 2 ee then in 


order to get the best approximation the number of terms increases 
as x takes larger values. 

Various mathematical processes may give rise to an asymptotic 
expansion of a function. Frequently, the series arise through the 
expansion of the given function by means of a Taylor’s series. Other 
methods such as repeated integration by parts may give rise to such 
an expansion, as the following illustration shows. 


Given the function 
. Sew 
i@-) 


By repeated integration by parts, we obtain the series 


Th 
ia 


ae po = Heer a 


This series is divergent for all finite values of 7; for, we have 
Ge 1 a 
a (n — 2)! 


i = Il 
a 


Un 
Un—-1 


= L 


nao 


L 


no 


d 
no 


which becomes infinite for all finite values of 2. The above series, 
however, represents the given function asymptotically for large 
positive values of x. For, we have for the remainder R,,(x) after the 


first 7 terms, copr—t 


R,(z) = (= 1)" (n+ 1) if prt. 


As this integral is taken over the interval (a, ©), we can assume 
t 2 x and hence have 
dt n\ 


co ,2—t foe) 
| F(Z) | i (n a: pif ond < (n+ f {rt2 = ntl 
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From the definition of asymptotic expansion, we have 


n! 
ta — S, Se Vader al) 
atte (f(z) Oy lke 
We may then write for large positive values of x 
1 1 2! 7: meee (n a 1)! 
Ober nme 


From the foregoing discussion, it will be seen that the advantage 
of an asymptotic series for numerical calculations arises only when 
the given series happens to converge rapidly for the first few terms 
so as to bring the error by its use well within a desired limit. It may 
be shown that the asymptotic representation of a given function is 
unique; that is, a given function f(x) can have but one such expan- 
sion. The converse of this statement, however, is not true; that is, a 
given asymptotic expansion may represent more than one function. 

Two asymptotic expansions 


sr bn 

x“ ag 
are said to be equal if we have a, = b, for all values of n. It follows 
from the definition of asymptotic expansions that we can add, sub- 
tract, and multiply such expansions and thus obtain an asymptotic 
expansion of the sum, difference, and product of the given functions 
just as was done with convergent series. An asymptotic series can 
also be integrated term by term, thus obtaining an asymptotic 
expansion of the integral of the given function, provided the first 
two terms of the expansion are zero and the integral is taken over 
the interval (v7, ~). One can not, however, always differentiate an 
asymptotic series term by term and thus obtain an asymptotic ex- 
pansion of the derivative function without having independent 
knowledge that the derivative function has an asymptotic expansion 
in terms of integrable functions different from zero. It is not sur- 
prising to find that all asymptotic series can not be differentiated 
term by term; for, this property is not possessed by all convergent 

series. 

Another class of divergent series have been studied which differ 


1 For a full discussion of the properties of asymptotic series, including formal 
proofs of those conclusions stated in this article, see Bromwich’s Theory of Infinite 
Series, pp. 322-346; also Ford’s Studies on Divergent Series and Summability, 
pp. 22-74. 
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from asymptotic series in that instead of first converging and then 
diverging they may continuously diverge. A step in this direction 
was made by Frobenius when he showed! that for a power series 
a,x" which converges for x < 1 we have 


eee eee, (5) 
z1 no n+1 
where Sa = t%m+a.+ast> + »- +a. 


This result associates with the given series a definite value for x = 1 
although it is divergent for that value. 
Thus, suppose we have 


1 
— - a 2 _ 7s (tei tc 
LO a ; P— 442 — 7 +2 


This series does not converge for x = 1, but by the foregoing method 
we can associate with the series 
1-1+1-1+41-:: 


the result 3. For, we have 


Boe LS =0,282 =, ., §,- to, 
and hence we have 
Pe Si Se ee) eee 
no n+1 no 2(n + 1) oa 


The value thus obtained is precisely that which we obtain when we 
give to x the value one in the function which gave rise to the series. 

The question to be considered is whether one can so generalize the 
definition of a sum of a series that under certain conditions we can 
associate with a divergent series a definite number as its sum which 
may be used in mathematical discussions. If this can be done by 
some definite, previously determined plan, then the series is said to be 
summable by this method. Various definitions of summability are 
to be found in the literature. Any such definition, to be satisfactory, 
must be such that the same method gives the sum in the ordinary 
sense when applied for those values of « for which the series is con- 
vergent. This property is called the consistency or regularity of the 
definition? The method involved in the definition should also 


1 See Journ. fiir Math., Vol. 89 (1880), p. 262. 
2 The term permancy is also employed, see Knopp, Unendliche Rethen, p. 445. 
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include the additive property; that is, if Ey is summable, then 


> a, is also summable and if the two sums are respectively S and 


n=1 


S’, then we have S=a+S8’. 


Moreover, the method should be such that any two summable series 
can be added or subtracted term by term just as with convergent 
series. 

Two definitions are said to be mutually consistent if, whenever 
each of the definitions gives a value to the series, the two values are 
the same. 

Two definitions are equivalent if they have the same range and 
yield the same sum; that is, if either can be evaluated for a value 
X = 2%, the other can be evaluated for the same value, and the sum is 
the same by both methods. 

It is beyond the scope of this discussion to give a detailed account 
of the various methods of summability which are to be found in the 
literature,! but a brief summary of one or two of the methods most 
frequently used will be given. 

Holder 2 calls a given series 2a, summable of order one, if the limit 


y, Sat Si 8s 
nc n+ 1 
exists, where Sa =A +++ + > +p. 


If this limit does not exist, then he puts 


So = SonOr a Sse Sa n = 0,1, 2, 3, 
n+l 
and considers the limit 
So a S, ae ec S,, 
[2 eee 
no n+ 1 


If this limit exists and is equal to S, this value is called the sum of 
the series, and the series is said to be summable of order two. If this 
limit does not exist then he puts 


Ce) ge Oo oe Sire 


1 For a citation and synopsis of the literature on summability, the reader is 
referred to Smail’s History and Synopsis of the Theory of Summable Infinite Proc- 
esses. 

2 See Math. Ann., Vol. 20 (1882), p. 535. 
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and considers the limit 


Ib, So aia 8, aF re oe Sag + Snes 
no n+ il 


In general, the given series is said to be summable of order r, if r is 
the smallest value for which the limit 


TS ead: So? 2 fe So a eee ae Sees) 
no n— 0 nm + I 
exists. 

Cesaro' starts with the same arithmetical mean as Holder and 
says the series 2 a, is summable with simple indeterminancy if the 
iy 7, Sot Sit: = +8; 

no n+1l 
exists. He then generalizes the notion of indeterminancy, or order, 
somewhat differently from Hélder in that he says that the given 
series Da, is summable of order r, if r is the smallest positive integer 
for which the limit 
== ()) (6) 


exists, where 


$= Sp + 18.1 + PVs, 94: - presen 
Pe DO 2)o es 
n ———— n! 


It is of interest to note that the methods of Holder and Cesaro 
are equivalent.” 
Ex. 1. Consider the summability by Cesiro’s method of the series 


1-2+3-4+5-6+:°:>:. 
We have So=1, Si=-—1, S2=2, S3 = -2,- 


For r = 1, we have from the above definition 


S, = 0, if n is odd, 


M+2 . fni 
= din + 1)’ li n 1s even. 
DGewe i 
Bi 
Consequently, the limit L x does not exist. 
na D 


1 See Bulletin des Sct. Math. (2), Vol. 14 (1890), p. 114. 
2 See Schnee, Math. Ann., Vol. 67 (1908), pp. 110-125; also Schur, Math. Ann. 


Vol. 74 (1913), pp. 447-458. 
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For r = 2, we have _ §,,°) = m+ 2er, if n is even. 


- GEV +2), it nis odd. 


= (n+ VD(m+2), 
at 2 
Hence, we obtain 
Si 5 (t2%(n+4) 2 
n> D,,”) ee: 8 (n + 1)(n + 2) 
_ _ et 3) eee 
Bir 8 (n+1)(n+2) 4 


The given series is, therefore, summable Cesaro, the sum being }, and the degree 
of indeterminancy is 2. 


Borel ! has proposed two definitions of summability, one of which 
employs an integral as a means of summation. His definitions are 
generalizations of that of Cesaro, 
ee ri OF LHD ee 


If we put C= 


where a is any constant, the sequence {c,} decreases indefinitely as 
n becomes infinite and the series 2c, converges. Consider the func- 
tion @(a), where 

$(a) = CoS0 se cy} aa ODS Se Gon gee es r 


© ot (7) 
Co +5 C1 ae Cor - Cn + 


Let us suppose the series in the numerator to converge for all values 
of a. The function ¢(a) is then uniquely defined. In this discus- 
sion, the values of ¢(a) take the place of the expression 


Doh or eies Men 
(ea at 
in the definition by Cesaro. If we have 
L (a) =S, 


a—>o 


? 


then the given series is said to be summable with the sum S. How- 
ever, we have 


D Cn = e%, 
and by putting —-S(a) = E eS, a z Sa”, (8) 


1 See Mémoire sur les séries divergentes, Ann. Ecole Normale (3), Vol. 16 (1899), 
pp. 9-131, 132-136; also Lecons sur les séries divergentes, pp. 97, 98. 
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this definition of Borel’s can be written as follows: 


G50 e° 


(9) 


This method of summation is not always applicable, and Borel 
was led to present another definition based on an integral as follows. 
Consider the series 


D tn = Wo +t + tee + Se a hs Se Cie 
and let Sa=Utmttet> + *+%1+4,. 
From (8) we have 
Sa) = Fe Sot FHSS t-  - 45,84. ~~. (10) 
By differentiating se) with respect to a, we obtain by aid of (10) 


e-(S’(a) — S(a)]=e? | (s: — So) + (S2 — Si)a + (S3 — 5 mush 


qu loka 
+ (Sa — Sr) G@—pl* ane | = ef us + us at te $5 + a 
qr-1 
aa cass Se GV =tiS:)e kelly) 


Putting this last series identically equal to ¢i(a), we have 
d —a 4 —a, 
= {e-*S(a)} = e*ds(a). 


Remembering the definition of the sum as given by (9), we have 
upon integrating the above relation 


fo eedlarda = *8(a) |” = 8 wo 12) 
2 0 
Integrating the first member by parts, we obtain 


epee le J “éx(a)aa |” rs i “ea if ‘ o(a)da | ie Ge) 


As the series defining ¢;(a) is a power series and can be integrated 
term by term, we have 


‘a (oo) f a2 a” © 
bel gx(a)da| = [ene { wa + m5 + ag Tea Bea: al 
= 0, 
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since we have L—= 


for all values of n. Consequently, from (13) we obtain 


eerie ip | fll “$x(a)da |da. (14) 


But uw is a constant and f e~* da = 1, and hence (14) can. be written 
in the form , 


S - [re ae + JP dlaraa | da 


= -a{ i ae ee ° MET ee aes My 
ae é Beans 1 25] mal 5 
. : a a 

Putting U(a) = Uo + Wid + Usa) + psig + Un + et 


we have the result S= a “e-2U(a)da, 


where as before S is called the sum of the given series 
Zn = Up + + 2+ > + + + Unt: 
As an illustration, consider the series 
l-x+27?-2734-+--+-4+(-—1)"a*+--- 


for values of e > 1. We have already seen how we can associate with this series 
the value } for x =1. We shall now show how Borel’s method of summation 


for values of x > 1. 


enables us to associate this series with the function I : 


We have + & 
aa ax? 
U(a) SL 5 oy =e, 
foe} 
S= fev @aa = {ere-*"da - f e-(t*)¢dq = u : 
0 0 l+2z 


that is, the given divergent series is summable with the sum i ~. 

It can be shown! that these definitions of summability are con- 
sistent; that is, they give the sum in the ordinary sense when applied 
to convergent series. They also satisfy the boundary value condi- 
tions. In other words, if the radius of convergence of the given 


1 See Ford’s Studies, Arts. 37-39, General Aspects of the Theory of Summable 
Series; and also Hurwitz’s article in the Bulletin of Amer. Math. Soc., Vol. 28 
(1922), entitled A Report on Topics in the Theory of Divergent Series. 
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power series 2 a,c” is 1 and within the interval of convergence 
defines the function f(x), then we have 
Se Le J). 
2—>1- 
While the fact that these definitions satisfy the boundary value 
conditions gives some advantage in certain mathematical discussions, 
there are good reasons why such conditions should not be imposed as 
an essential part of the definition of summability.1_ These definitions 
likewise satisfy the laws of addition and subtraction of infinite series 
just as convergent series do. However, the integral method of Borel 
does not possess the additive property. 

The foregoing definitions have been generalized by various authors 
and other definitions are to be found in the recent mathematical 
literature.” 

It is of importance to know which, if any, of the mathematical 
processes which we make use of in connection with convergent series 
can be extended to summable series. To answer such questions, 
Borel* found it convenient to introduce what he calls absolute sum- 
(mability. He says that a given series is absolutely summable if not 


only the integral if e-*u(a)da has a value but also each of the 
integrals ; 


fro | u(a) | aa, [* | wr(a) | da, X= 1,2,- + 5% 


where u(a) denotes the A” derivative of u(a). 
It can not be inferred that, because a series is convergent, it is 


1 See Carmichael, General Aspects of the Theory of Summable Series, Bulletin 
of Amer. Math. Soc., Vol. 25 (1918), pp. 125-127. 

2 For a citation of literature and an abstract of the content of various papers 
pertaining to summable series, the reader is referred to Smail’s History and Synop- 
sis of the Theory of Summable Infinite Processes. Particular attention is called 
to the definitions and extensions to be found in the writings of Hélder, Le Roy, 
de Vallée Poussin, Knopp, and Riesz. For a more complete discussion of sum- 
mable series, see Bromwich’s Infinite Series, Chap. XI, Ford’s Studies on Diver- 
gent Series and Summability, and Borel’s Lecons sur les séries divergentes (18* Ed. 
1901, 24 Ed. 1928). Fora discussion of the more recent developments, the reader 
is referred to Carmichael’s article in Bulletin of the Amer. Math. Soc. for Dec., 
1918, on General Aspects of the Theory of Summable Series and to Hurwitz’s 
article in the Bulletin of Amer. Math. Soc., Vol. 28 (1922), entitled, A Report on 
Topics in the Theory of Divergent Series. 

3 See Lecons sur les séries divergentes, p. 99. 
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necessarily absolutely summable. However, all absolutely con- 
vergent series are absolutely summable.! 

Among the properties of absolutely summable series, we have the 
following: ? 

(1) If the given series is absolutely summable, then a finite num- 
ber of the terms can be rearranged, or a finite number of consecutive 
terms can be replaced by their sum without affecting either the sum 
or the summability of the series. 

co 2 eo 
(2) If the series Du,, Dv,, LY wp, are absolutely summable, hav- 
a= a= n=0 
ing the sums 4, 2, w, respientivedy, then if we put 


ZL, = au, + be, + ave, n=1,2,3,- - -, 
the series = z, is absolutely summable and has the sum 


z=au+bv+cw. 
(3) Iftheseries J un, > v, are absolutely summable and if we put 


n=0 n=0 


Wn = Un + Una t- * * + Undo, 


So 
then the series } w, is absolutely summable and has the sum w-». 


Hardy has shown that it is sufficient for the summability of a product 
that one of the factor series shall be absolutely summable.* 

(4) If we have given a polynomial P(u, v,w) having numerical 
coefficients and if we replace u, v, w by absolutely summable series, 
we obtain an absolutely summable series of which the sum is equal 
to the numerical value obtained from P(u, v, w) by replacing u, v, w 
by the corresponding sums of the series. 

Hardy has introduced the notion of uniform summability He 
based his definition on the Borel notion of summability and it is as 
follows: é 

A given series 2u,(x) is uniformly summable in the interval 


a=0 foe) 
a <2z< 6 if for all values of x the integral i e¥ u(x, y)dy con- 
verges uniformly, where u(z, y) is defined by the relation 


u(y) Sua(z)2- (15) 
n=0 nN: 


1 See Hardy, Researches in the Theory of Divergent Series and Divergent Integrals, 
pp. 22-66; also Bromwich’s Infinite Series, p. 276. 

* See Borel’s Lecons, etc., p. 99 et seq. 

* See Trans. Camb. Phil. Soc., Vol. 19 (1903), p. 301. 
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On the basis of this definition it can be shown that if the terms 
un(x) of the given series are continuous functions of 2 and the series 
(15) converges uniformly for each value of y, then the sum of the 
given series is a continuous function of « provided the given series 
is uniformly summable.' os 

If the series of derivatives 2 u,/(x) is uniformly summable, and 


fos) qm ne 
; y ; 
~) ' P . . tA 
the series 2D uy! (x) | converges uniformly, then the series can be dif- 
n=0 4 


ferentiated term by term; that is, we have ? 
Diz Un(2) = 2 Datta). 


Similarly it follows that, if the given series 2 u,(#) is uniformly 
summable in (a, b) and the series (15) converges uniformly through- 
out the domain (O, X, a, 6), then the given series can be integrated 
term by term and we have ” 


b . 
iL Lun(x) = J f ayaa: 


A somewhat different definition of uniform summability has been 
set up by C. N. Moore ? in that the given series 2 un(«) is said to be 
uniformly summable in the interval (a, 6), if for a<a < b the 
expression 


So(x) + Sil) ++ + + Sn(x) 
n+] : 
where Sn(x) = uo(z) + u(x) ++ + + + Un(), 


converges uniformly. Upon the basis of this definition the results 
given above also follow. 

Just as with convergent series, uniform summability is not a 
necessary condition for the continuity of the sum function.? One 
may, however, set up a necessary and sufficient condition for the 
continuity of the sum by extending to summable series the notion of 


quasi-uniformity of the approach to a limit. 


1 See Bromwich’s Theory of Infinite Series, Art. 109. 

2 See Trans. Amer. Math. Soc., Vol. 10 (1909), p. 400. 

3 For illustrative example and proof of the following statements, see 
F. J. McMackin’s Columbia Dissertation (1916) on Some Theorems of Summable 


Divergent Series. 
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EXERCISES 


1. Given the series 
GR i eae 


ie ce 
Can the terms of this series be rearranged at pleasure without affecting the con- 
vergence or the sum? Give eg for pereee 


2. Given the two series 2 = al’ pp =(- yj 2 = Can they be multiplied? If so 
form the product. i 

3. Show that the series 
cos2z  cos3x  cos4z 

22 ar 3? ar 42 
converges uniformly. Give the interval of uniform convergence. Plot some of the 
approximation curves. 

4. Let S, = nze-"*. Does it converge uniformly? Quasi-uniformly? Can 
the series be integrated term by term? In each case state the interval over which 
your conclusion holds. ,, 

5. Given the series Zz (—1)*“2". Show that it can be integrated term by 


paca 


+ . 


cos x + 


term and thus obtain nee value of log 2. 

6. Given ei 
d(t) =tsin>) t#0, 

= 0, t=0. 

By the principle of condensation of singularities, define by aid of $(¢), a function 
f(x) which shall be finite and continuous having no derivative at the set of rational 
points. 

7. Given the series 

Gigs ee 
sind = 2-7 +5 - ait ae 


show that one can by differentiation obtain the expansion of cos x and then by 
multiplication find the expansion of sin 2x. Give reasons for each step and carry 
out the necessary operations. 

8. Consider the series given in Ex. 2, Art. 57. While this series does not con- 
verge uniformly, show that it converges quasi-uniformly in the interval (— 1, 1). 
What consequences follow from this conclusion? 

9. Show that the series 
log a log 2a log(n —1) a 

i? Sig ie aa 
can be integrated and differentiated term by term. What statement can be 
made about the interval of convergence of the ree series? 


10. Discuss the existence of the integral le ne 


tinued integration by parts develop an asymptotic Sepaenion of this function for 
large positive values of z. 
11. The function ¢(y) = L y* has, by Ex. 2, Art. 25, the value zero for 
t0 


a*=1+ 


a+. 


By con- 


y = 0 and otherwise the value 1. By Cantor’s method of condensation of singu- 
larities set up a function f(z) having a removable singularity at the points: 
1] 


1 


Ca uteareCie Oeatia 


YOR an k 
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12. Show that the series 
1 —23433- 434. - -4+(-1)*(n4+1)? +: cuore 
is summable Cesaro of order four. . 
13. Given the series 


1 1 ay 1 1 
(1-%)+($-3)+(G-@)* ne 


Without summing this series show that one may remove the parentheses without 
affecting the convergence or the sum of the series. Show also that the series 


ube al eel yee olige: © 1 1 1 
2° Soe SF Ie 
has the same sum as the given series. . 
14. Which of the following series converge uniformly? If uniformly conver- 


gent, state the interval within which this is true. 


age a 
(a) l+z+5)+° . ebaneny hi ous 
: sin2r sin3z sin nx 
(b) sinz+ R R +: . “+ a +> e oa 
(etre — Dies) hae a 


Plot enough approximation curves in each case to justify your conclusion. 

15. In the interval (0, 1) let f(z) have the value zero in all points where 
az = (3)", n= 0, 1, 2,3, - - +, and the value 1 at all other points. Show that 
f(x) can be represented by a convergent series each term of which is a continuous 
function in the given interval. 

16. Can a series converge uniformly without converging absolutely? Quasi- 
uniformly and not uniformly? Can it converge without being absolutely sum- 
mable by Borel’s definition? Illustrate your conclusions. 

17. State four important things concerning power series. Illustrate each 
with an exercise. 

18. In Ex. 3, Art. 59, we have considered a series where S,,(x), considered as a 
function of n and z together, is not bounded, although bounded in x for each 
value of n. For what set of values of x could this condition be true and still the 
series be integrated term by term over the interval containing them. If this is 
possible, illustrate your conclusion. 

19. Let f(z) be defined by the series 

1 1 1 
ioe + 87 ioe t 748i! the 
Show that one is justified in differentiating this series term by term in order to 
obtain the derivative of f(x) for values of x in a certain interval. Determine that 
interval. 


+ 


n = nia a5 
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(Numbers refer to pages.) 


Absolute continuity, 102, 206, 307, 320. 

Absolute convergence of infinite inte- 
grals, 240, 265, 266. 

Absolute convergence of a series, 335, 
340, 368, 371, 374. 

Absolute summability of series, 397. 

Algebraic function, 81. 

Algebraic number, 17, 77. 

Approximation curves, 115, 347. 

Arbitrarily small, definition of, 1. 

Asymptotic series, 388. 

Axiom of Archimedes, 18. 

Axiom of continuity, 19. 


Baire’s classification of functions, 144, 
145, 146, 164, 324, 325. 

Base of numerical system, 22. 

Borel measure, 323, 324, 325. 

Boundary point of a set, 30, 56. 

Bounded function, 81, 215, 216, 217, 
218, 219, 221, 222, 229, 242, 247, 
252, 257, 260, 270, 287, 290, 291, 
292, 293, 294, 315, 316. 

Bounded sequence, 3, 5. 

Bounded sets, 28, 61, 63, 70. 


Cardinal number, 27, 48, 51, 54, 130, 
138, 140, 142, 186. 

Change of variables, 222, 224. 

Characteristic function, 324. 

Closed interval, 79. 

Closed set, 30, 37, 44-46, 50, 63, 126, 
128, 135. 

Complementary sets, 29. 

Condensation of singularities, Han- 
kel’s method, 375; Cantor’s method, 
385. 

Conditionally convergent series, 336, 
337. 


Content, 58-64. 

Continuity, 98-100, 107-123, 130, 135, 
138, 140, 142, 161-168, 172, 173, 175, 
184, 218, 216, 217, 220, 222, 224, 
226-229, 251, 252, 257, 261, 267, 
268, 284, 318, 352, 357, 358, 374. 

Continuous functions with no deriva- 
tives, 155-160. 

Continuum, 30, 39, 48, 53, 54, 56. 

Convergence of infinite integrals, 240- 
247. 

Convergent sequence, 3, 34. 

Convergent series, definition of, 333. 


Denjoy integral, 328. 

Dense in itself, 46. 

Derivative, 149, 161, 163, 164, 165, 
224, 226, 227, 230, 284, 309, 312, 
315, 316, 317, 319, 320, 363, 365. 

Derivative number, 149, 151, 166, 167, 
168, 208, 222, 224, 228, 229, 284, 
309, 312, 318. 

Derived sets, 28, 35, 37, 43, 46, 60. 

Differentiation as inverse of integra- 
tion, 230-233, 322. 

Differentiation of series, 363-367, 373. 

Differentiation under integral sign, 262, 
263. 

Discontinuity of first kind, 99, 134, 
205, 214. 

Discontinuity of second kind, 99. 

Discontinuous functions, 127, 128, 132, 
134, 135, 205, 237, 246, 283. 

Discrete set, 60, 61, 63, 64, 212. 

Divergence of infinite integrals, 240, 
242. 

Divergent series, 333, 387-399. 

Double integrals (Riemann), 268-274; 
(Lebesgue), 289, 325-326. 
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Enumerable set, 28, 37-438, 44, 47, 50, 
51, 52, 55, 63, 68, 72, 73, 134, 206, 
257. 

Equi-absolute continuity, 301, 302, 
305, 363, 366. 

Equivalent sets, 31. 

Everywhere dense sets, 28, 47, 52, 135. 

Exterior measure, 65, 67, 68, 69, 70. 

Exterior point of a set, 30. 


Finite integral, 199. 

First category, sets of, 50-55. 

First species, sets of, 36, 43, 61. 

Fundamental theorem of integral cal- 
culus, 229, 322. 


Heine-Borel theorem, 44, 45, 57. 

Hellinger integral, 328. 

Higher derivatives, 152, 153. 

Indefinite integral (Riemann), 225, 
226-233; (Lebesgue), 306-322. 

Infinite integrals, 199, 234-250, 297- 
306, 322. 

Inner content, 59. 

Inner limiting set, 132. 

Inner point of a set, 29. 

Integrals involving a parameter, 250- 
264. 

Integration of series, 358-363, 373. 

Interior measure, 65. 

Interval, 21, 41. 

Interval of convergence of a series, 
334. 

Trrational numbers, 7, 41; Cantor’s 
theory of, 9; Dedekind’s theory of, 
iil. 

Trrational points, 20, 41. 

Isolated point, 29, 46. 

Isolated set, 29, 41. 

Iterated integrals, 269, 270. 

Iterated limit, 85. 

Interchange of order of differentiation, 
189, 190, 192, 194. 

Interchange of order of integration 
(Riemann), 270; (Lebesgue), 325. 


Jordan measure, 59. 


INDEX 


Law of the mean for differential cal- 
culus, 160; for integral calculus, 
220-222, 290. 

Lebesgue integral, definition of, 285; 
condition for existence of, 287; com- 
parison with Riemann integral, 295, 
321; for non-bounded functions, 
297-306; of two independent varia- 
bles, 323-327. 

Left-hand derivative, 149. 

Left-hand limit, 85. 

Limited variation, 202, 203, 204, 205, 
206, 208, 214, 308, 319. 

Limit of a sequence, 33; of a function, 
82; condition for the existence of, 
95, 97. 

Limits, laws of operation with, 88-97. 

Limiting function of a sequence, 82, 
281, 282, 294, 295, 301, 302, 304, 305. 

Limiting point of a set, 28, 35. 

Linear continuum, 39. 

Linear set defined, 25. 

Lower boundary, 31, 81, 219. 

Lower boundary function, 82, 281. 

Lower integral, 200, 223, 269. 

Lower limit, 31, 81. 

Lower limiting function, 82, 282, 284. 

Lower semi-continuous function, 123, 
124, 126. 


Maximum, 81, 109. 

Measure, 64, 70, 72-76, 212, 215, 283, 
299. 

Measurable function, 277-284, 287, 
290-295, 315, 362. 

Monotone function, 214, 215, 221, 222, 
224, 242, 247, 317, 318. 

Monotone sequence, 4, 5, 281. 

Multiple-valued function, 80. 

Multiplication of series, 342-345, 374. 


Natural numbers, 1. 

Neighborhood, 21. 

Non-enumerable sets, 28, 39, 41, 42, 
46, 50. 

Non-linear sets, 56. 


Open set, 30, 44-46. 
Ordered set, 30. 


INDEX 


Ordinary discontinuity, 99, 205, 214. 
Oscillation, 100, 101. 


Parentheses, removal of, in a series, 
338, 339. 

Partial derivatives, 170, 172, 173, 175, 
185, 186, 187, 190, 192, 194. 

Perfect set, definition of, 30; proper- 
ties of, 46-50. 

Perron integral, 330. 

Point of condensation, 29, 42, 44, 46. 

Point-wise continuous function, 1382, 
138, 140. 

Point-wise discontinuity, 104, 127, 129, 
130, 175, 353. 

Power series, 367-375. 

Primitive function, 227. 

Principal part of infinite integral, 235. 

Product of point sets, 32. 


Quasi-uniform convergence of func- 
tions, 121, 122, 257; of infinite inte- 
grals, 265, 267; of infinite series, 
355-358, 359, 360, 362. 

Quasi-uniform convergence in general 
of functions, 122, 256; of infinite 
integrals, 265, 268. 


Radius of convergence of power series, 
369. 

Rational function, 81. 

Rational integral function, 81. 

Rational numbers, definition of, 1; se- 
quence of, 3; partition of, 11. 

Rational points, 18, 39, 51. 

Real numbers, definition of, 8; system 
of, 12, 13, 14; sequence of, 14; 
geometric representation of, 17. 

Reducible set of points, 237. 

Regular sequence, 4, 5, 15. 

Removable discontinuity, 99. 

Riemann integral, 198, 209-221, 224, 
229, 237, 251, 252, 256, 257, 260, 295. 

Right-hand derivative, 149. 

Right-hand limit, 85. 


Saltus, 101. 
Second category, sets of, 50, 53, 54. 
Second species, sets of, 37, 43. 
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Semi-continuous functions, 123-127, 
128. 

Sequence defined, 3; regular sequence, 
4, 5; bounded sequence, 3, 4, 5; 
convergent, 3; of intervals, 22. 

Sequence of point sets, 33, 75, 76, 290, 
294; complete limit of, 33; restricted 
limit of, 34; convergence of, 3, 34. 

Simply-uniform convergence of series, 
353-355. 

Simultaneous limit, 86, 91. 

Single-valued function, 80. 

Stieltjes integral, 327. 

Subtraction of point sets, 32. 

Subtraction of series, 342. 

Sum of point sets, 32, 37. 

Sum of series, 342. 

Summable function, 298-308, 312, 318, 
320, 362, 363. 

Summability of series, 391; Hélder’s 
method, 392; Cesaro’s method, 393; 
Borel’s method, 394. 


Total differentiability, 177, 180-187. 
Total variation, 202, 308. 
Transcendental function, 81. 
Transcendental numbers, 17. 
Transfinite numbers, 26-27, 43. 


Uniform continuity, 103, 107. 

Uniform convergence of functions, 115- 
119, 142, 164, 187, 260; of integrals, 
264-268; of series, 345-353, 361, 
363, 371. 

Uniform summability of series, 398. 

Upper bound, 31, 219. 

Upper boundary function, 82, 281. 

Upper integral, 200, 223, 269. 

Upper limit of a set, 31; of a function, 
81. 

Upper limiting function, 82, 282, 284. 

Upper semi-continuous function, 123, 
125, 126, 174. 


Variation, see limited variation. 


Weierstrass test for uniform conver- 
gence of series, 349. 
Well-ordered set, 31, 37. 
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